00010000:00010000:1.0F:1784938581.877099:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0F:1784938582.474640:0:24729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836571 is committed 00000004:00080000:0.0:1784938582.474701:0:24729:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:0.0:1784938582.474719:0:24729:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1784938582.475450:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342483200:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938582.475547:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342483712:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938582.475576:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784938582.475581:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342483584:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938582.475596:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342484096:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938582.475911:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938582.475975:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938582.475994:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938582.476014:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938582.476050:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342483200 00000100:00100000:1.0:1784938582.476056:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342483200 00000100:00100000:1.0:1784938582.476099:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342483712 00000100:00100000:1.0:1784938582.476101:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342483712 00000100:00100000:1.0:1784938582.476114:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342483584 00000100:00100000:1.0:1784938582.476116:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342483584 00000100:00100000:1.0:1784938582.476127:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342484096 00000100:00100000:1.0:1784938582.476129:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342484096 00000100:00100000:1.0:1784938582.476144:0:16102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 848 00000100:00100000:1.0:1784938582.476151:0:16102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:12805:x1871643342483200:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938582.476178:0:16102:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:177 count 1 00002000:00010000:1.0:1784938582.476207:0:16102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb1:0x0] initial LVB size: 4117, mtime: 0x6a640014, atime: 0x0, ctime: 0x6a640014, blocks: 0x13 00010000:00010000:1.0:1784938582.476215:0:16102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d50070/0xcd9d312a94a0696a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.476232:0:16102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb1:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1784938582.476236:0:16102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938582.476243:0:16102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d50070/0xcd9d312a94a0696a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.476259:0:16102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9d50070/0xcd9d312a94a0696a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.476268:0:16102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d50070/0xcd9d312a94a0696a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.476285:0:16102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d50070/0xcd9d312a94a0696a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.476301:0:16102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938582.476789:0:16102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:12805:x1871643342483200:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 637us (878us total) trans 4294967529 rc 0/0 00000100:00100000:1.0:1784938582.476797:0:16102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 848 00000100:00100000:1.0:1784938582.476815:0:16102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 849 00000100:00100000:1.0:1784938582.476821:0:16102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:12805:x1871643342483712:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938582.476832:0:16102:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:181 count 1 00010000:00010000:1.0:1784938582.476842:0:16102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.476855:0:16102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a058bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d7 expref: 39 pid: 19392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.476863:0:16102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb5:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1784938582.476879:0:16102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938582.476884:0:16102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.476909:0:16102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a058bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d7 expref: 39 pid: 19392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.476934:0:16102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a058bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d7 expref: 39 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938582.476948:0:16102:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:16102:1871643342484224:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938582.476991:0:16102:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473bb1ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938582.477012:0:17487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 850 00000100:00100000:1.0:1784938582.477019:0:17487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:12805:x1871643342483584:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938582.477031:0:17487:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:201 count 1 00002000:00010000:1.0:1784938582.477047:0:17487:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc9:0x0] initial LVB size: 1048576, mtime: 0x6a640017, atime: 0x0, ctime: 0x6a640017, blocks: 0x803 00010000:00010000:1.0:1784938582.477053:0:17487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001269a36/0xcd9d312a94a06978 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.477061:0:17487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1784938582.477064:0:17487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938582.477069:0:17487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001269a36/0xcd9d312a94a06978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.477078:0:17487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001269a36/0xcd9d312a94a06978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.477086:0:17487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001269a36/0xcd9d312a94a06978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.477093:0:17487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001269a36/0xcd9d312a94a06978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.477113:0:17487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1784938582.477332:0:17487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:12805:x1871643342483584:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 313us (1337us total) trans 4294967530 rc 0/0 00000100:00100000:1.0:1784938582.477338:0:17487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 850 00000100:00100000:1.0:1784938582.477351:0:17487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 851 00000100:00100000:1.0:1784938582.477356:0:17487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:12805:x1871643342484096:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938582.477367:0:17487:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:192 count 1 00010000:00010000:1.0:1784938582.477377:0:17487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.477388:0:17487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a05ad0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51da expref: 39 pid: 19392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.477395:0:17487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1784938582.477398:0:17487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938582.477402:0:17487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.477417:0:17487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a05ad0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51da expref: 39 pid: 19392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.477427:0:17487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a05ad0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51da expref: 39 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938582.477448:0:17487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17487:1871643342484352:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938582.477468:0:17487:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473bb1ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938582.478121:0:12805:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967528 gen 2 00000004:00080000:0.0:1784938582.478129:0:12805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601f3c380, transno 4294967528 00000100:00100000:0.0:1784938582.478144:0:12805:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff974601c20a80 x1871643342483584/t4294967530(4294967530) o6->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:28/4 lens 544/432 e 0 to 0 dl 1784938598 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1784938582.478154:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601c20a80/2, rc 0, transno 4294967530 00000100:00100000:0.0:1784938582.478159:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342483584:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:0.0:1784938582.478170:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601c21180/2, rc 0, transno 4294967529 00000100:00100000:0.0:1784938582.478174:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342483200:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938582.478438:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938582.478449:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342484480:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938582.478572:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0F:1784938582.478578:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342483328:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938582.478592:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974717eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342484992:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938582.478834:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342483840:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0F:1784938582.480949:0:19405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342484480 00000100:00100000:3.0:1784938582.480973:0:19405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342484480 00000100:00100000:0.0:1784938582.481094:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342485504:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938582.481171:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784938582.481178:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974717ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342484864:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938582.481213:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342485376:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938582.481407:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938582.481460:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938582.481485:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938582.481508:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938582.481527:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938582.481546:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342485504 00000100:00100000:0.0:1784938582.481550:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342485504 00010000:00010000:1.0:1784938582.481557:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938582.481566:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9d50070/0xcd9d312a94a0696a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.481580:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29800 already unused, calling callback (ffffffffc14344a0) 00000100:00100000:0.0:1784938582.481581:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342485376 00000100:00100000:0.0:1784938582.481583:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342485376 00010000:00010000:1.0:1784938582.481585:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d50070/0xcd9d312a94a0696a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.481597:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d50070/0xcd9d312a94a0696a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.481597:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342483328 00000100:00100000:0.0:1784938582.481599:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342483328 00000100:00100000:0.0:1784938582.481613:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342484992 00000100:00100000:0.0:1784938582.481616:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342484992 00010000:00010000:1.0:1784938582.481621:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9d50070/0xcd9d312a94a0696a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.481628:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342484864 00010000:00010000:1.0:1784938582.481629:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9d50070/0xcd9d312a94a0696a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.481630:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342484864 00000100:00100000:0.0:1784938582.481647:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 852 00010000:00010000:1.0:1784938582.481650:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938582.481654:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001269a36/0xcd9d312a94a06978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.481654:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:12805:x1871643342485504:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1784938582.481672:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938582.481681:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001269a36/0xcd9d312a94a06978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1784938582.481684:0:19390:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:167 count 1 00010000:00010000:1.0:1784938582.481689:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001269a36/0xcd9d312a94a06978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.481698:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001269a36/0xcd9d312a94a06978 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.481704:0:19390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.481705:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001269a36/0xcd9d312a94a06978 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.481719:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.481719:0:19390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001695dcd8/0xcd9d312a94a058d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d0 expref: 34 pid: 19388 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.481721:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938582.481722:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.481727:0:19390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa7:0x0].0x0 since=6s v=(0 0) 00000100:00080000:1.0:1784938582.481732:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784938582.481732:0:19390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa7:0x0].0x0 since=0s v=(0 0) 00000100:00080000:1.0:1784938582.481735:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784938582.481736:0:19390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938582.481767:0:19393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 853 00000100:00100000:1.0:1784938582.481774:0:19393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:12805:x1871643342485376:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938582.481787:0:19393:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:200 count 1 00010000:00010000:0.0:1784938582.481792:0:19390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001695dcd8/0xcd9d312a94a058d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d0 expref: 34 pid: 19388 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.481804:0:19390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001695dcd8/0xcd9d312a94a058d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d0 expref: 34 pid: 19388 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938582.481809:0:19393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc8:0x0] initial LVB size: 0, mtime: 0x6a640017, atime: 0x6a640017, ctime: 0x6a640017, blocks: 0x1 00010000:00010000:1.0:1784938582.481814:0:19393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6177e92/0xcd9d312a94a0698d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.481816:0:19390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:19390:1871643342485760:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938582.481822:0:19393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1784938582.481825:0:19393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938582.481831:0:19393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6177e92/0xcd9d312a94a0698d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.481849:0:19393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6177e92/0xcd9d312a94a0698d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.481858:0:19390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746044c2e40 going to sleep for 11 seconds 00010000:00010000:1.0:1784938582.481859:0:19393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6177e92/0xcd9d312a94a0698d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.481879:0:19393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6177e92/0xcd9d312a94a0698d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.481888:0:19398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 854 00000100:00100000:0.0:1784938582.481894:0:19398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:12802:x1871643342483328:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1784938582.481896:0:19393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1784938582.481907:0:19398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:178 count 1 00002000:00010000:0.0:1784938582.481923:0:19398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb2:0x0] initial LVB size: 4150, mtime: 0x6a640014, atime: 0x0, ctime: 0x6a640014, blocks: 0x13 00010000:00010000:0.0:1784938582.481927:0:19398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a06994 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.481935:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb2:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1784938582.481937:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.481941:0:19398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a06994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.481950:0:19398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a06994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.481957:0:19398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a06994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.481968:0:19398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a06994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.481981:0:19398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1784938582.482424:0:19398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+11:12802:x1871643342483328:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 527us (935us total) trans 4294967531 rc 0/0 00000100:00100000:0.0:1784938582.482431:0:19398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 854 00000100:00100000:0.0:1784938582.482451:0:19398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 855 00000100:00100000:0.0:1784938582.482457:0:19398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473bab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:12805:x1871643342484992:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1784938582.482468:0:19398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:190 count 1 00002000:00010000:0.0:1784938582.482484:0:19398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbe:0x0] initial LVB size: 170595, mtime: 0x6a640016, atime: 0x0, ctime: 0x6a640016, blocks: 0x203 00010000:00010000:0.0:1784938582.482490:0:19398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0699b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.482498:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbe:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1784938582.482501:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.482505:0:19398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0699b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.482514:0:19398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0699b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.482521:0:19398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0699b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.482539:0:19398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0699b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.482556:0:19398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1784938582.482984:0:19398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473bab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+9:12805:x1871643342484992:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 524us (1473us total) trans 4294967532 rc 0/0 00000100:00100000:0.0:1784938582.482992:0:19398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 855 00000100:00100000:0.0:1784938582.483012:0:19398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 856 00000100:00100000:0.0:1784938582.483020:0:19398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:12805:x1871643342484864:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1784938582.483034:0:19398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:177 count 1 00002000:00010000:0.0:1784938582.483051:0:19398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb1:0x0] initial LVB size: 3079, mtime: 0x6a640014, atime: 0x0, ctime: 0x6a640014, blocks: 0xb 00010000:00010000:0.0:1784938582.483057:0:19398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b29bdd2/0xcd9d312a94a069a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483065:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb1:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1784938582.483068:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.483072:0:19398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b29bdd2/0xcd9d312a94a069a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483081:0:19398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b29bdd2/0xcd9d312a94a069a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483089:0:19398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b29bdd2/0xcd9d312a94a069a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483107:0:19398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b29bdd2/0xcd9d312a94a069a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483116:0:19398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1784938582.483413:0:19398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:12805:x1871643342484864:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 392us (1884us total) trans 4294967533 rc 0/0 00000100:00100000:0.0:1784938582.483420:0:19398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 856 00010000:00010000:0.0:1784938582.483466:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784938582.483474:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6177e92/0xcd9d312a94a0698d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483481:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.483486:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6177e92/0xcd9d312a94a0698d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483494:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6177e92/0xcd9d312a94a0698d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483510:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6177e92/0xcd9d312a94a0698d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483517:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6177e92/0xcd9d312a94a0698d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483534:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938582.483543:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a06994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483550:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.483553:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a06994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483560:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a06994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483570:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a06994 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483576:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a06994 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483588:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938582.483591:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0699b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483596:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.483599:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0699b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483606:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0699b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483627:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0699b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483634:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0699b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483645:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938582.483648:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b29bdd2/0xcd9d312a94a069a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483654:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.483657:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b29bdd2/0xcd9d312a94a069a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483665:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b29bdd2/0xcd9d312a94a069a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483673:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b29bdd2/0xcd9d312a94a069a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483680:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b29bdd2/0xcd9d312a94a069a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.483691:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.483692:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.483699:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.483711:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938582.485835:0:19393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:12805:x1871643342485376:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 4049us (4363us total) trans 4294967534 rc 0/0 00000100:00100000:1.0:1784938582.485849:0:19393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 853 00000100:00100000:1.0:1784938582.485909:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342483456:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938582.485958:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342483968:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938582.485994:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974717ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342484736:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938582.486019:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974717eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342485248:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938582.487154:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342484608:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938582.487550:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974717ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342485120:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938582.487573:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342485632:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938582.488673:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938582.488717:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938582.488778:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938582.488920:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938582.488939:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938582.488956:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938582.488975:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938582.488993:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938582.489023:0:19397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342483840 00000100:00100000:2.0:1784938582.489031:0:19397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342483840 00000100:00100000:1.0:1784938582.489146:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342485248 00000100:00100000:1.0:1784938582.489150:0:19396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342485248 00000100:00100000:1.0:1784938582.489191:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342485120 00000100:00100000:1.0:1784938582.489195:0:19396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342485120 00000100:00100000:1.0:1784938582.489207:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342483456 00000100:00100000:1.0:1784938582.489209:0:19396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342483456 00000100:00100000:1.0:1784938582.489237:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342483968 00000100:00100000:1.0:1784938582.489240:0:19396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342483968 00000100:00100000:1.0:1784938582.489250:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342484736 00000100:00100000:1.0:1784938582.489252:0:19396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342484736 00000100:00100000:1.0:1784938582.489260:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342484608 00000100:00100000:1.0:1784938582.489262:0:19396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342484608 00000100:00100000:1.0:1784938582.489271:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342485632 00000100:00100000:1.0:1784938582.489274:0:19396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342485632 00000100:00100000:1.0:1784938582.489289:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 857 00000100:00100000:1.0:1784938582.489298:0:19396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:12803:x1871643342485248:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938582.489333:0:19396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:169 count 1 00002000:00010000:1.0:1784938582.489370:0:19396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa9:0x0] initial LVB size: 4915, mtime: 0x6a640013, atime: 0x0, ctime: 0x6a640013, blocks: 0x13 00010000:00010000:1.0:1784938582.489379:0:19396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add487f3/0xcd9d312a94a069a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.489397:0:19396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa9:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1784938582.489401:0:19396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938582.489409:0:19396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000add487f3/0xcd9d312a94a069a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.489425:0:19396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000add487f3/0xcd9d312a94a069a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.489436:0:19396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000add487f3/0xcd9d312a94a069a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.489443:0:19396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000add487f3/0xcd9d312a94a069a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.489473:0:19396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938582.490044:0:19396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:12803:x1871643342485248:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 744us (1322us total) trans 4294967535 rc 0/0 00000100:00100000:1.0:1784938582.490053:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 857 00000100:00100000:1.0:1784938582.490079:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 858 00000100:00100000:1.0:1784938582.490086:0:19396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:12802:x1871643342485120:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938582.490102:0:19396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:170 count 1 00002000:00010000:1.0:1784938582.490122:0:19396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xaa:0x0] initial LVB size: 16001, mtime: 0x6a640013, atime: 0x0, ctime: 0x6a640013, blocks: 0x23 00010000:00010000:1.0:1784938582.490128:0:19396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cf50166/0xcd9d312a94a069b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.490137:0:19396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaa:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1784938582.490140:0:19396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938582.490144:0:19396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cf50166/0xcd9d312a94a069b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.490155:0:19396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cf50166/0xcd9d312a94a069b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.490163:0:19396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cf50166/0xcd9d312a94a069b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.490171:0:19396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cf50166/0xcd9d312a94a069b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.490197:0:19396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1784938582.490490:0:12805:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967531 gen 2 00000004:00080000:0.0:1784938582.490497:0:12805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472ff21880, transno 4294967531 00000100:00100000:0.0:1784938582.490512:0:12805:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff974717ee9500 x1871643342484864/t4294967533(4294967533) o6->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 544/432 e 0 to 0 dl 1784938598 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1784938582.490524:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974717ee9500/2, rc 0, transno 4294967533 00000100:00100000:0.0:1784938582.490530:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974717ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342484864:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:0.0:1784938582.490542:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601f3c380/2, rc 0, transno 4294967534 00000100:00100000:0.0:1784938582.490545:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342485376:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:0.0:1784938582.490554:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974717eea300/2, rc 0, transno 4294967532 00000100:00100000:0.0:1784938582.490557:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974717eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342484992:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938582.490579:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 859 00000100:00100000:0.0:1784938582.490589:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:12803:x1871643342483456:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938582.490605:0:19388:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:164 count 1 00002000:00010000:0.0:1784938582.490625:0:19388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa4:0x0] initial LVB size: 9974, mtime: 0x6a640012, atime: 0x0, ctime: 0x6a640012, blocks: 0x23 00010000:00010000:0.0:1784938582.490630:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a069b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.490639:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa4:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1784938582.490643:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.490646:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a069b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.490656:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a069b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.490672:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a069b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.490678:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a069b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.490685:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1784938582.491366:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:12803:x1871643342483456:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 777us (2444us total) trans 4294967532 rc 0/0 00000100:00100000:0.0:1784938582.491374:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 859 00000100:00100000:0.0:1784938582.491395:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 860 00000100:00100000:0.0:1784938582.491402:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:12803:x1871643342483968:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938582.491416:0:19388:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:180 count 1 00010000:00010000:0.0:1784938582.491430:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.491443:0:19388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bce55b7c/0xcd9d312a94a058e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50fa expref: 39 pid: 19396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.491450:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb4:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1784938582.491453:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.491457:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 4/0,1 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.491499:0:19388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bce55b7c/0xcd9d312a94a058e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50fa expref: 39 pid: 19396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.491511:0:19388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bce55b7c/0xcd9d312a94a058e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50fa expref: 39 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.491524:0:19388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19388:1871643342485888:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938582.491575:0:19388:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746044c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938582.491597:0:19394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 861 00000100:00100000:0.0:1784938582.491604:0:19394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:12803:x1871643342484736:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1784938582.491616:0:19394:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:176 count 1 00002000:00010000:0.0:1784938582.491634:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb0:0x0] initial LVB size: 234, mtime: 0x6a640014, atime: 0x0, ctime: 0x6a640014, blocks: 0xb 00010000:00010000:0.0:1784938582.491640:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009733c361/0xcd9d312a94a069c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.491647:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb0:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1784938582.491650:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.491654:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009733c361/0xcd9d312a94a069c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.491664:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009733c361/0xcd9d312a94a069c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.491673:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009733c361/0xcd9d312a94a069c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.491688:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009733c361/0xcd9d312a94a069c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.491697:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1784938582.493611:0:19397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 862 00000100:00100000:2.0:1784938582.493624:0:19397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+14:12802:x1871643342484608:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938582.493654:0:19397:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:163 count 1 00010000:00010000:2.0:1784938582.493681:0:19397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.493700:0:19397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9d69314/0xcd9d312a94a05eb9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5300 expref: 39 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.493709:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1784938582.493727:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.493731:0:19397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.493788:0:19397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9d69314/0xcd9d312a94a05eb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5300 expref: 39 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.493800:0:19397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9d69314/0xcd9d312a94a05eb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5300 expref: 39 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.493814:0:19397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f606680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:19397:1871643342486016:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938582.493904:0:19397:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747056e9540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938582.493939:0:16105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 863 00000100:00100000:2.0:1784938582.493949:0:16105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:12802:x1871643342485632:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938582.493965:0:16105:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:178 count 1 00010000:00010000:2.0:1784938582.493988:0:16105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.494002:0:16105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a058c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50de expref: 34 pid: 19392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.494009:0:16105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb2:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1784938582.494011:0:16105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.494015:0:16105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.494047:0:16105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a058c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50de expref: 34 pid: 19392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.494058:0:16105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a058c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50de expref: 34 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.494068:0:16105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f604700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:16105:1871643342486144:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938582.494093:0:16105:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747056e9900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938582.494113:0:19395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 864 00000100:00100000:2.0:1784938582.494121:0:19395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:12802:x1871643342483840:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938582.494136:0:19395:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:189 count 1 00010000:00010000:2.0:1784938582.494149:0:19395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.494161:0:19395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9471409/0xcd9d312a94a058ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50f3 expref: 39 pid: 19396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.494169:0:19395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbd:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1784938582.494172:0:19395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.494175:0:19395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 4/0,1 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.494194:0:19395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9471409/0xcd9d312a94a058ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50f3 expref: 39 pid: 19396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.494217:0:19395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9471409/0xcd9d312a94a058ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50f3 expref: 39 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.494227:0:19395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:19395:1871643342486272:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938582.494252:0:19395:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747056e9e40 going to sleep for 11 seconds 00000004:00080000:2.0:1784938582.494460:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601c22680/2, rc 0, transno 4294967531 00000100:00100000:2.0:1784938582.494477:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342483328:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938582.494704:0:19394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:12803:x1871643342484736:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 3099us (5745us total) trans 4294967536 rc 0/0 00000100:00100000:0.0:1784938582.494712:0:19394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 861 00010000:00010000:0.0:1784938582.494748:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784938582.494775:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000add487f3/0xcd9d312a94a069a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494784:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.494788:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000add487f3/0xcd9d312a94a069a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494798:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000add487f3/0xcd9d312a94a069a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494817:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000add487f3/0xcd9d312a94a069a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494823:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000add487f3/0xcd9d312a94a069a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494843:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938582.494854:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cf50166/0xcd9d312a94a069b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494860:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.494863:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cf50166/0xcd9d312a94a069b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494884:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cf50166/0xcd9d312a94a069b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494907:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cf50166/0xcd9d312a94a069b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494913:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cf50166/0xcd9d312a94a069b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494927:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938582.494933:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a069b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494939:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.494942:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a069b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494949:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a069b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494970:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a069b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494977:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a069b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494989:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938582.494993:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009733c361/0xcd9d312a94a069c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.494999:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148ba00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.495002:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009733c361/0xcd9d312a94a069c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.495009:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009733c361/0xcd9d312a94a069c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.495017:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009733c361/0xcd9d312a94a069c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.495023:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009733c361/0xcd9d312a94a069c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.495307:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.495310:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.495315:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.495324:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938582.496598:0:19396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:12802:x1871643342485120:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 6504us (7811us total) trans 4294967537 rc 0/0 00000100:00100000:1.0:1784938582.496609:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 858 00000100:00100000:1.0:1784938582.496640:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 865 00000100:00100000:1.0:1784938582.496651:0:19396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:12804:x1871643342484480:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00010000:00010000:3.0:1784938582.498293:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938582.498309:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938582.498339:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342486528:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938582.498442:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938582.498449:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342486656:192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938582.498624:0:19396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:179 count 1 00010000:00010000:1.0:1784938582.498666:0:19396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.498689:0:19396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3bd84ce/0xcd9d312a94a05b16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51ef expref: 39 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.498698:0:19396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb3:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1784938582.498702:0:19396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938582.498707:0:19396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.498741:0:19396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3bd84ce/0xcd9d312a94a05b16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51ef expref: 39 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.498770:0:19396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3bd84ce/0xcd9d312a94a05b16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51ef expref: 39 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938582.498806:0:19396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:19396:1871643342486784:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938582.498853:0:19396:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473bb1a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938582.501208:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938582.501242:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938582.501521:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342486528 00000100:00100000:1.0:1784938582.501531:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342486528 00000100:00100000:1.0:1784938582.501573:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342486656 00000100:00100000:1.0:1784938582.501576:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342486656 00000100:00100000:1.0:1784938582.501595:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 866 00000100:00100000:1.0:1784938582.501604:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:12804:x1871643342486528:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938582.501635:0:19389:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:181 count 1 00010000:00010000:1.0:1784938582.501671:0:19389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.501692:0:19389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a058d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50ec expref: 34 pid: 19388 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.501701:0:19389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb5:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1784938582.501705:0:19389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938582.501709:0:19389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.501741:0:19389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a058d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50ec expref: 34 pid: 19388 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.501769:0:19389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a058d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50ec expref: 34 pid: 19388 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938582.501801:0:19389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19389:1871643342486912:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938582.501883:0:19389:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473bb1aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938582.501907:0:16104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 867 00000100:00100000:3.0:1784938582.501918:0:16104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:12804:x1871643342486656:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938582.501937:0:16104:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:182 count 1 00010000:00010000:3.0:1784938582.501950:0:16104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.501963:0:16104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3c198e5/0xcd9d312a94a058df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5101 expref: 34 pid: 19396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.501969:0:16104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb6:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1784938582.501972:0:16104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.501975:0:16104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 4/0,1 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.501995:0:16104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3c198e5/0xcd9d312a94a058df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5101 expref: 34 pid: 19396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.502005:0:16104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3c198e5/0xcd9d312a94a058df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5101 expref: 34 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.502038:0:16104:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:16104:1871643342487040:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938582.502064:0:16104:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747360933c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938582.503971:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342487168:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938582.504082:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974717ee9180/2, rc 0, transno 4294967537 00000100:00100000:3.0:1784938582.504110:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974717ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342485120:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938582.504125:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938582.504132:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342486400:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938582.504178:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601c21500/2, rc 0, transno 4294967532 00000100:00100000:3.0:1784938582.504190:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342483456:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938582.504202:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974717ee9c00/2, rc 0, transno 4294967536 00000100:00100000:3.0:1784938582.504208:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974717ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342484736:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938582.504306:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974717eebb80/2, rc 0, transno 4294967535 00000100:00100000:3.0:1784938582.504321:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974717eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342485248:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938582.504331:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342487296:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938582.504372:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342487424:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938582.504424:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938582.504430:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342487552:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938582.504555:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342487680:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938582.505215:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938582.505328:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938582.509995:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938582.510323:0:19393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342487680 00000100:00100000:3.0:1784938582.510348:0:19393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342487680 00000100:00100000:3.0:1784938582.510398:0:19393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342487168 00000100:00100000:3.0:1784938582.510401:0:19393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342487168 00000100:00100000:3.0:1784938582.510430:0:19393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 868 00000100:00100000:3.0:1784938582.510440:0:19393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:12802:x1871643342487680:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938582.510477:0:19393:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:184 count 1 00010000:00010000:3.0:1784938582.510504:0:19393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.510523:0:19393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075dd444e/0xcd9d312a94a05b0f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e8 expref: 34 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.510533:0:19393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb8:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1784938582.510538:0:19393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.510542:0:19393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.510578:0:19393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075dd444e/0xcd9d312a94a05b0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e8 expref: 34 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.510590:0:19393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075dd444e/0xcd9d312a94a05b0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e8 expref: 34 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.510604:0:19393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:19393:1871643342487808:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938582.510817:0:19394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 869 00000100:00100000:0.0:1784938582.510826:0:19394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:12802:x1871643342487168:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938582.510840:0:19394:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:176 count 1 00010000:00010000:0.0:1784938582.510855:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.511221:0:19393:0:(client.c:2702:ptlrpc_set_wait()) set ffff974736093600 going to sleep for 11 seconds 00010000:00010000:0.0:1784938582.511456:0:19394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a05ed5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5307 expref: 39 pid: 16105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.511468:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1784938582.511471:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.511475:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 4/0,1 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.511499:0:19394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a05ed5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5307 expref: 39 pid: 16105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.511509:0:19394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a05ed5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5307 expref: 39 pid: 16105 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.511521:0:19394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:19394:1871643342487936:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938582.511567:0:19394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746044c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938582.511706:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938582.511726:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938582.511745:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938582.511829:0:19399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342486400 00000100:00100000:0.0:1784938582.511834:0:19399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342486400 00000100:00100000:0.0:1784938582.511860:0:19399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342487296 00000100:00100000:0.0:1784938582.511862:0:19399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342487296 00000100:00100000:0.0:1784938582.512017:0:19399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342487424 00000100:00100000:0.0:1784938582.512021:0:19399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342487424 00000100:00100000:0.0:1784938582.512035:0:19399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342487552 00000100:00100000:0.0:1784938582.512037:0:19399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342487552 00000100:00100000:0.0:1784938582.512051:0:19399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 870 00000100:00100000:0.0:1784938582.512059:0:19399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+18:12802:x1871643342486400:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1784938582.512078:0:19399:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:186 count 1 00010000:00010000:0.0:1784938582.512096:0:19399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.512110:0:19399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a058ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50e5 expref: 34 pid: 19392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.512118:0:19399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xba:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1784938582.512121:0:19399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.512125:0:19399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.512144:0:19399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a058ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50e5 expref: 34 pid: 19392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.512154:0:19399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a058ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50e5 expref: 34 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.512181:0:19399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19399:1871643342488064:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938582.512232:0:19399:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746044c20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938582.512253:0:19398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 871 00000100:00100000:0.0:1784938582.512260:0:19398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+18:12803:x1871643342487296:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1784938582.512273:0:19398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:187 count 1 00010000:00010000:0.0:1784938582.512285:0:19398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.512296:0:19398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0b736e4/0xcd9d312a94a05b08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e1 expref: 34 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.512302:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbb:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1784938582.512305:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.512308:0:19398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 4/0,1 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.512325:0:19398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0b736e4/0xcd9d312a94a05b08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e1 expref: 34 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.512334:0:19398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0b736e4/0xcd9d312a94a05b08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e1 expref: 34 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.512343:0:19398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19398:1871643342488192:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938582.512375:0:19398:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746044c2300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938582.513505:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938582.513537:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938582.513603:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326020992 00000100:00100000:3.0:1784938582.513621:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326020992 00000100:00100000:2.0:1784938582.513719:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1784938582.513722:0:19391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a058bc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d7 expref: 40 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.513744:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938582.513803:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326021120 00000100:00100000:3.0:1784938582.513810:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326021120 00000100:00100000:2.0:1784938582.513811:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1784938582.513838:0:19391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a05ad0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51da expref: 41 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.513854:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938582.513883:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326021376 00000100:00100000:3.0:1784938582.513887:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326021376 00010000:00010000:3.0:1784938582.513911:0:19391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9d69314/0xcd9d312a94a05eb9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5300 expref: 42 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.513926:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326021248 00000100:00100000:3.0:1784938582.513929:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326021248 00010000:00010000:3.0:1784938582.513955:0:19391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001695dcd8/0xcd9d312a94a058d8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d0 expref: 35 pid: 19388 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.513969:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326021632 00000100:00100000:3.0:1784938582.513972:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326021632 00010000:00010000:3.0:1784938582.513989:0:19391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9471409/0xcd9d312a94a058ed lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50f3 expref: 43 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.514001:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326021504 00000100:00100000:3.0:1784938582.514003:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326021504 00010000:00010000:3.0:1784938582.514014:0:19391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bce55b7c/0xcd9d312a94a058e6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50fa expref: 44 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.514027:0:19391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 349 00000100:00100000:3.0:1784938582.514044:0:19391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974710d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+44:10023:x1871643326020992:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938582.514063:0:19391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938582.514070:0:19391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a058bc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d7 expref: 44 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.514087:0:19391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a058bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d7 expref: 44 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.514121:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.514126:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.514132:0:19391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.514144:0:19391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.514169:0:19391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938582.515009:0:19391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974710d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+44:10023:x1871643326020992:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 960us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938582.515023:0:19391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 349 00000100:00100000:3.0:1784938582.515114:0:19391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 350 00000100:00100000:3.0:1784938582.515125:0:19391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f605880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+43:10023:x1871643326021120:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938582.515142:0:19391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938582.515150:0:19391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a05ad0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51da expref: 43 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515462:0:19391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a05ad0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51da expref: 43 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515490:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.515494:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.515500:0:19391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515511:0:19391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515535:0:19391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938582.515563:0:19391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f605880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+43:10023:x1871643326021120:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 441us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938582.515569:0:19391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 350 00000100:00100000:3.0:1784938582.515585:0:19391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 351 00000100:00100000:3.0:1784938582.515592:0:19391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+42:10025:x1871643326021376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938582.515603:0:19391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938582.515609:0:19391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9d69314/0xcd9d312a94a05eb9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5300 expref: 42 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515620:0:19391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9d69314/0xcd9d312a94a05eb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5300 expref: 42 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515646:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.515650:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.515655:0:19391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515663:0:19391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515676:0:19391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938582.515696:0:19391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+42:10025:x1871643326021376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 104us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938582.515702:0:19391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 351 00000100:00100000:3.0:1784938582.515718:0:19391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 352 00000100:00100000:3.0:1784938582.515725:0:19391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+35:10026:x1871643326021248:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938582.515734:0:19391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938582.515740:0:19391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001695dcd8/0xcd9d312a94a058d8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d0 expref: 35 pid: 19388 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515779:0:19391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001695dcd8/0xcd9d312a94a058d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d0 expref: 35 pid: 19388 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515795:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.515798:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.515802:0:19391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515817:0:19391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515831:0:19391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938582.515855:0:19391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+35:10026:x1871643326021248:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 128us (2112us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938582.515864:0:19391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 352 00000100:00100000:3.0:1784938582.515892:0:19391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 353 00000100:00100000:3.0:1784938582.515904:0:19391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+41:10024:x1871643326021632:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938582.515913:0:19391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938582.515919:0:19391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9471409/0xcd9d312a94a058ed lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50f3 expref: 41 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515930:0:19391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9471409/0xcd9d312a94a058ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50f3 expref: 41 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515946:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.515952:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938582.515957:0:16102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a058bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d7 expref: 41 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515958:0:19391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.515993:0:19391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938582.516012:0:16102:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:16102:1871643342484224:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938582.516033:0:19391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938582.516053:0:16102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.516065:0:19391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+40:10024:x1871643326021632:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 161us (2251us total) trans 0 rc 0/0 00010000:00010000:1.0:1784938582.516073:0:16102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.516079:0:19391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 353 00010000:00010000:1.0:1784938582.516095:0:16102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.516106:0:19391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 354 00010000:00010000:1.0:1784938582.516115:0:16102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.516123:0:19391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472ff21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+39:10024:x1871643326021504:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938582.516143:0:19391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938582.516151:0:19391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bce55b7c/0xcd9d312a94a058e6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50fa expref: 39 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.516188:0:16102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.516214:0:16102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938582.516779:0:16102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:12805:x1871643342483712:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 39955us (40800us total) trans 4294967533 rc 0/0 00000100:00100000:1.0:1784938582.516789:0:16102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 849 00000100:00100000:1.0:1784938582.516820:0:16102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 872 00000100:00100000:1.0:1784938582.516832:0:16102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:12804:x1871643342487424:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938582.516864:0:16102:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:163 count 1 00010000:00010000:1.0:1784938582.516902:0:16102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.516920:0:16102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005444b3d/0xcd9d312a94a05b1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51f6 expref: 34 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.516928:0:16102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1784938582.516932:0:16102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938582.516936:0:16102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.516968:0:16102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005444b3d/0xcd9d312a94a05b1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51f6 expref: 34 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.516994:0:16102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005444b3d/0xcd9d312a94a05b1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51f6 expref: 34 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938582.517010:0:16102:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:16102:1871643342488320:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938582.517063:0:16102:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473bb1a540 going to sleep for 11 seconds 00010000:00010000:1.0:1784938582.517099:0:17487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a05ad0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51da expref: 39 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938582.517114:0:17487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17487:1871643342484352:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938582.517132:0:17487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.517140:0:17487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.517147:0:17487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.517156:0:17487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.517163:0:17487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.517198:0:17487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1784938582.517554:0:17487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:12805:x1871643342484096:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 40195us (41537us total) trans 4294967534 rc 0/0 00000100:00100000:1.0:1784938582.517562:0:17487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 851 00000100:00100000:1.0:1784938582.517580:0:17487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 873 00000100:00100000:1.0:1784938582.517587:0:17487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:12804:x1871643342487552:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938582.517602:0:17487:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:194 count 1 00010000:00010000:1.0:1784938582.517615:0:17487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.517626:0:17487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a05edc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5323 expref: 38 pid: 17487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.517632:0:17487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1784938582.517635:0:17487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938582.517639:0:17487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.517658:0:17487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a05edc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5323 expref: 38 pid: 17487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.517669:0:17487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a05edc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5323 expref: 38 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938582.517692:0:17487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17487:1871643342488448:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938582.517719:0:17487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747104d3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938582.517746:0:19389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19389:1871643342486912:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938582.517786:0:19389:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.519436:0:19391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bce55b7c/0xcd9d312a94a058e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50fa expref: 38 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.519486:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.519492:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.519501:0:19391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.519513:0:19391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.519547:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1784938582.519557:0:19391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938582.519604:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938582.519668:0:19391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472ff21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+38:10024:x1871643326021504:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3546us (5819us total) trans 0 rc 0/0 00010000:00010000:0.0:1784938582.519694:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1784938582.519702:0:19391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 354 00010000:00010000:0.0:1784938582.519709:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.519725:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.519731:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.519744:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.519794:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326021760 00010000:00010000:0.0:1784938582.519800:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.519808:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326021760 00010000:00010000:0.0:1784938582.519812:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a06971 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.519846:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938582.519850:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.519857:0:19391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3bd84ce/0xcd9d312a94a05b16 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51ef expref: 38 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.519861:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.519882:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.519898:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326021888 00000100:00100000:3.0:1784938582.519903:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326021888 00010000:00010000:0.0:1784938582.520084:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.520106:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.520113:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000239d4ce5/0xcd9d312a94a0697f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.520128:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.520130:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.520132:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.520174:0:19388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bce55b7c/0xcd9d312a94a058e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50fa expref: 38 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.520188:0:19388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19388:1871643342485888:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938582.520209:0:19388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.520218:0:19388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.520224:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.520233:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.520251:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.520273:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938582.521942:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938582.521977:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938582.522021:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326022016 00000100:00100000:2.0:1784938582.522028:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326022016 00010000:00010000:2.0:1784938582.522070:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3c198e5/0xcd9d312a94a058df lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5101 expref: 36 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.522094:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326022144 00000100:00100000:2.0:1784938582.522096:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326022144 00010000:00010000:2.0:1784938582.522107:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a058c3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50de expref: 37 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.522133:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 355 00000100:00100000:2.0:1784938582.522143:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+37:10025:x1871643326021760:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938582.522158:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938582.522164:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3bd84ce/0xcd9d312a94a05b16 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51ef expref: 37 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522177:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3bd84ce/0xcd9d312a94a05b16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51ef expref: 37 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522198:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.522202:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.522208:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522217:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522236:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938582.522269:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+37:10025:x1871643326021760:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 128us (2733us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938582.522276:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 355 00000100:00100000:2.0:1784938582.522294:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 356 00000100:00100000:2.0:1784938582.522301:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+37:10023:x1871643326022016:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938582.522316:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938582.522321:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3c198e5/0xcd9d312a94a058df lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5101 expref: 37 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522329:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3c198e5/0xcd9d312a94a058df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5101 expref: 37 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522343:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.522346:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.522350:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522357:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522369:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938582.522389:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+37:10023:x1871643326022016:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 88us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938582.522396:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 356 00000100:00100000:2.0:1784938582.522412:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 357 00000100:00100000:2.0:1784938582.522420:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+36:10024:x1871643326022144:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938582.522428:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938582.522432:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a058c3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50de expref: 36 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522457:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a058c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50de expref: 36 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522469:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.522473:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.522477:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522484:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522499:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938582.522521:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+36:10024:x1871643326022144:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 102us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938582.522527:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 357 00010000:00010000:2.0:1784938582.522573:0:19397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9d69314/0xcd9d312a94a05eb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5300 expref: 36 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.522589:0:19397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f606680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:19397:1871643342486016:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938582.522614:0:19397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522625:0:19397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522643:0:19397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522654:0:19397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522662:0:19397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.522686:0:19397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938582.522715:0:19391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a058d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50ec expref: 35 pid: 19388 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.522802:0:19391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 358 00000100:00100000:3.0:1784938582.522818:0:19391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974710d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+35:10025:x1871643326021888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938582.522836:0:19391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938582.522845:0:19391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a058d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50ec expref: 35 pid: 19388 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.522863:0:19391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a058d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50ec expref: 35 pid: 19388 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.523210:0:19397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+18:12802:x1871643342484608:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 29584us (34231us total) trans 4294967536 rc 0/0 00000100:00100000:2.0:1784938582.523220:0:19397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 862 00010000:00010000:2.0:1784938582.523264:0:16105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a058c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50de expref: 35 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.523275:0:16105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f604700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:16105:1871643342486144:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938582.523287:0:16105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.523295:0:16105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.523301:0:16105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.523316:0:16105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.523323:0:16105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.523339:0:16105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1784938582.523686:0:16105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:12802:x1871643342485632:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 29738us (34691us total) trans 4294967538 rc 0/0 00000100:00100000:2.0:1784938582.523694:0:16105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 863 00010000:00010000:2.0:1784938582.523728:0:19395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9471409/0xcd9d312a94a058ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50f3 expref: 35 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.523741:0:19395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:19395:1871643342486272:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938582.523776:0:19395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.523785:0:19395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.523792:0:19395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.523800:0:19395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.523817:0:19395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.523824:0:19395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1784938582.524161:0:19395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:12802:x1871643342483840:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 30040us (35508us total) trans 4294967537 rc 0/0 00000100:00100000:2.0:1784938582.524169:0:19395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 864 00000100:00100000:2.0:1784938582.524479:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938582.524509:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938582.524535:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938582.524596:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1784938582.524612:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784938582.524621:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524638:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148b800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938582.524643:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524654:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524676:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524696:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004fd61ce/0xcd9d312a94a069be lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524719:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784938582.524724:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524729:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924ec00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938582.524732:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524739:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524768:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524777:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d892b605/0xcd9d312a94a069cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524789:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938582.524793:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524799:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924e200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938582.524808:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524815:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524826:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524832:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a069d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524846:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938582.524849:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.524855:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938582.524858:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.525569:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.525591:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.525597:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a069da lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.525621:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938582.525624:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938582.525626:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938582.525650:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326022272 00000100:00100000:2.0:1784938582.525670:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326022272 00010000:00010000:2.0:1784938582.525701:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075dd444e/0xcd9d312a94a05b0f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e8 expref: 35 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.525723:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326022400 00000100:00100000:2.0:1784938582.525727:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326022400 00010000:00010000:2.0:1784938582.525740:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a05ed5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5307 expref: 35 pid: 16105 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.525771:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326022528 00000100:00100000:2.0:1784938582.525774:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326022528 00010000:00010000:2.0:1784938582.525789:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a058ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50e5 expref: 36 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.525799:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326022656 00000100:00100000:2.0:1784938582.525801:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326022656 00010000:00010000:2.0:1784938582.525812:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0b736e4/0xcd9d312a94a05b08 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e1 expref: 37 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.525827:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 359 00000100:00100000:2.0:1784938582.525834:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+37:10025:x1871643326022272:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938582.525849:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938582.525859:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075dd444e/0xcd9d312a94a05b0f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e8 expref: 37 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.525885:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075dd444e/0xcd9d312a94a05b0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e8 expref: 37 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526344:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.526351:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.526358:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526369:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526390:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938582.526449:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+37:10025:x1871643326022272:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 613us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938582.526458:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 359 00000100:00100000:2.0:1784938582.526480:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 360 00000100:00100000:2.0:1784938582.526487:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+35:10025:x1871643326022400:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938582.526496:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938582.526500:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a05ed5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5307 expref: 35 pid: 16105 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526510:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a05ed5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5307 expref: 35 pid: 16105 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526533:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.526537:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.526540:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526547:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526557:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938582.526575:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+35:10025:x1871643326022400:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 89us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938582.526581:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 360 00000100:00100000:2.0:1784938582.526592:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 361 00000100:00100000:2.0:1784938582.526598:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+36:10023:x1871643326022528:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938582.526606:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938582.526611:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a058ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50e5 expref: 36 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526621:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a058ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50e5 expref: 36 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526631:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.526634:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.526638:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526651:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526669:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938582.526687:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+36:10023:x1871643326022528:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 89us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938582.526694:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 361 00000100:00100000:2.0:1784938582.526707:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 362 00000100:00100000:2.0:1784938582.526714:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+35:10023:x1871643326022656:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938582.526721:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938582.526726:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0b736e4/0xcd9d312a94a05b08 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e1 expref: 35 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526735:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0b736e4/0xcd9d312a94a05b08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e1 expref: 35 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526746:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.526783:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.526788:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526796:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.526820:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938582.526837:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+35:10023:x1871643326022656:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 124us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938582.526843:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 362 00010000:00010000:3.0:1784938582.527317:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a058d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50ec expref: 34 pid: 19388 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.527341:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.527345:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.527365:0:19391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.527374:0:19391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.527414:0:19391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938582.527475:0:19391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974710d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+33:10025:x1871643326021888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4663us (7870us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938582.527486:0:19391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 358 00000100:00080000:3.0:1784938582.527576:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938582.527583:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784938582.527602:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784938582.527665:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601c23800/2, rc 0, transno 4294967537 00000100:00100000:3.0:1784938582.527691:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342483840:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938582.527706:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9747358f8700/2, rc 0, transno 4294967536 00000100:00100000:3.0:1784938582.527710:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342484608:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:3.0:1784938582.527726:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601f3f480/2, rc 0, transno 4294967538 00000100:00100000:3.0:1784938582.527742:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342485632:192.168.202.104@tcp:6:osp-syn-0-0.0 00010000:00010000:3.0:1784938582.527802:0:16104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3c198e5/0xcd9d312a94a058df lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5101 expref: 32 pid: 19396 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.527819:0:16104:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:16104:1871643342487040:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938582.527848:0:16104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.527883:0:16104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.527891:0:16104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.527903:0:16104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.527913:0:16104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.528832:0:19389:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.528853:0:19389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.528875:0:19389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.528883:0:19389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.529263:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:12803:x1871643342483968:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 37853us (40314us total) trans 4294967535 rc 0/0 00000100:00100000:0.0:1784938582.529276:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 860 00010000:00010000:0.0:1784938582.529356:0:19394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a05ed5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5307 expref: 34 pid: 16105 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.529371:0:19394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:19394:1871643342487936:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938582.529391:0:19394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.529401:0:19394:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.529406:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.529414:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.529421:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.529847:0:16104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784938582.529862:0:19393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075dd444e/0xcd9d312a94a05b0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e8 expref: 31 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.529898:0:19393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:19393:1871643342487808:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938582.529921:0:19393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.529931:0:19393:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.529938:0:19393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.529947:0:19393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.529953:0:19393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.530202:0:19389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1784938582.530908:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:12804:x1871643342486528:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 29300us (29705us total) trans 4294967539 rc 0/0 00000100:00100000:1.0:1784938582.530918:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 866 00010000:00010000:0.0:1784938582.531650:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1784938582.531985:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784938582.531998:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532018:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938582.532022:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532033:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532065:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532074:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a069ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532103:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938582.532110:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532117:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938582.532121:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532129:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532141:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532156:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a069e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532175:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938582.532179:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532189:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148b600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938582.532192:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532200:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532214:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532222:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a069fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532239:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938582.532243:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532250:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938582.532261:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532269:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532278:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.532355:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938582.532357:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938582.532359:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938582.532894:0:19394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:12802:x1871643342487168:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 22061us (27556us total) trans 4294967538 rc 0/0 00000100:00100000:0.0:1784938582.532903:0:19394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 869 00010000:00010000:0.0:1784938582.532959:0:19399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a058ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50e5 expref: 30 pid: 19392 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.532977:0:19399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19399:1871643342488064:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938582.532996:0:19399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.533007:0:19399:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.533014:0:19399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.533022:0:19399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.533029:0:19399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.533112:0:19399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938582.534219:0:19393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938582.534238:0:19393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a069f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.534328:0:19399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+19:12802:x1871643342486400:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 22264us (24341us total) trans 4294967540 rc 0/0 00000100:00100000:0.0:1784938582.534342:0:19399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 870 00010000:00010000:0.0:1784938582.534650:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938582.534663:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.534672:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.534676:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.534684:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.534703:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.534709:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b00aaf0/0xcd9d312a94a06a04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.534724:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.534726:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.534727:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.534784:0:19398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0b736e4/0xcd9d312a94a05b08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51e1 expref: 29 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.534796:0:19398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19398:1871643342488192:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938582.534826:0:19398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.534835:0:19398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.534841:0:19398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.534850:0:19398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.534857:0:19398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.534884:0:19398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938582.537718:0:19398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+20:12803:x1871643342487296:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 25396us (25950us total) trans 4294967541 rc 0/0 00000100:00100000:0.0:1784938582.537732:0:19398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 871 00010000:00010000:0.0:1784938582.537799:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938582.537808:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.537818:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148bc00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.537823:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.537859:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.537898:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.537906:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034c3ba69/0xcd9d312a94a06a0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.537933:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.537935:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.537936:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938582.538017:0:19393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:12802:x1871643342487680:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 27577us (32803us total) trans 4294967542 rc 0/0 00000100:00100000:2.0:1784938582.538026:0:19393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 868 00010000:00010000:2.0:1784938582.538168:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938582.538215:0:19390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001695dcd8/0xcd9d312a94a058d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d50d0 expref: 28 pid: 19388 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.538227:0:19390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:19390:1871643342485760:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938582.538252:0:19390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.538262:0:19390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.538270:0:19390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.538280:0:19390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.538287:0:19390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.538324:0:19390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938582.538997:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:12805:x1871643342485504:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 57340us (57588us total) trans 4294967543 rc 0/0 00000100:00100000:2.0:1784938582.539006:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 852 00010000:00010000:2.0:1784938582.539142:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938582.539150:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.539160:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938582.539163:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.539172:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.539188:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.539194:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005411a22d/0xcd9d312a94a06986 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.539211:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938582.539213:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938582.539214:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.539282:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938582.542596:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938582.542668:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938582.542713:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326022912 00000100:00100000:2.0:1784938582.542720:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326022912 00010000:00010000:2.0:1784938582.542774:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a05edc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5323 expref: 34 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.542802:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326022784 00000100:00100000:2.0:1784938582.542805:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326022784 00010000:00010000:2.0:1784938582.542818:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005444b3d/0xcd9d312a94a05b1d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51f6 expref: 28 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.542839:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 363 00000100:00100000:2.0:1784938582.542847:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974710d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+34:10026:x1871643326022912:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938582.542862:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938582.542880:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a05edc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5323 expref: 34 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.542898:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a05edc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5323 expref: 34 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.542922:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.542926:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.542932:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.542942:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.542971:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938582.543019:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974710d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+34:10026:x1871643326022912:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 172us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938582.543027:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 363 00000100:00100000:2.0:1784938582.543176:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 364 00000100:00100000:2.0:1784938582.543183:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+28:10026:x1871643326022784:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938582.543191:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938582.543196:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005444b3d/0xcd9d312a94a05b1d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51f6 expref: 28 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.543208:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005444b3d/0xcd9d312a94a05b1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51f6 expref: 28 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.543221:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.543224:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.543228:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.543236:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.543247:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938582.543261:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+28:10026:x1871643326022784:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 79us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938582.543275:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 364 00010000:00010000:2.0:1784938582.543323:0:19396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3bd84ce/0xcd9d312a94a05b16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51ef expref: 33 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.543338:0:19396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:19396:1871643342486784:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938582.543357:0:19396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.543367:0:19396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.543374:0:19396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.543383:0:19396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.543391:0:19396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.543406:0:19396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938582.543822:0:17487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a05edc lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5323 expref: 32 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.543837:0:17487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17487:1871643342488448:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938582.543851:0:17487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.543860:0:17487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.543880:0:17487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.543906:0:17487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.543914:0:17487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.543928:0:17487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784938582.544284:0:19396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:12804:x1871643342484480:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 47635us (65711us total) trans 4294967539 rc 0/0 00000100:00100000:2.0:1784938582.544293:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 865 00010000:00010000:2.0:1784938582.544485:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938582.544496:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.544505:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938582.544510:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.544519:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.544537:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.544544:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a069e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.544564:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938582.544567:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.544573:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938582.544577:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.544584:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.544602:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.544609:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06a19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.544621:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938582.544623:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938582.544625:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938582.544630:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938582.544985:0:17487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:12804:x1871643342487552:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 27397us (33237us total) trans 4294967540 rc 0/0 00000100:00100000:0.0:1784938582.544993:0:17487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 873 00010000:00010000:1.0:1784938582.545200:0:16102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005444b3d/0xcd9d312a94a05b1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51f6 expref: 27 pid: 19393 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938582.545215:0:16102:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:16102:1871643342488320:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938582.545233:0:16102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.545243:0:16102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.545251:0:16102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.545260:0:16102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.545275:0:16102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.545288:0:16102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938582.545624:0:16102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:12804:x1871643342487424:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 28794us (33896us total) trans 4294967544 rc 0/0 00000100:00100000:1.0:1784938582.545631:0:16102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 872 00010000:00010000:0.0:1784938582.545937:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938582.545944:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.545954:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.545957:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.545966:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.545985:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.545992:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030315ad8/0xcd9d312a94a06a12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.546023:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.546025:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.546027:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938582.546974:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938582.547623:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342488832:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:2.0:1784938582.548403:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601f3f800/2, rc 0, transno 4294967543 00000100:00100000:2.0:1784938582.548427:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342485504:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:2.0:1784938582.548442:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601c20380/2, rc 0, transno 4294967534 00000100:00100000:2.0:1784938582.548453:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342484096:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:2.0:1784938582.548462:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601c23480/2, rc 0, transno 4294967533 00000100:00100000:2.0:1784938582.548465:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342483712:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938582.548478:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938582.548485:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342488704:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938582.552529:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938582.552564:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938582.552794:0:16104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:12804:x1871643342486656:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 50864us (51536us total) trans 4294967545 rc 0/0 00000100:00100000:3.0:1784938582.552815:0:16104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 867 00000100:00100000:3.0:1784938582.552883:0:16104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342488832 00000100:00100000:3.0:1784938582.552895:0:16104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342488832 00000100:00100000:3.0:1784938582.553901:0:16104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342488704 00000100:00100000:3.0:1784938582.553912:0:16104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342488704 00000100:00100000:3.0:1784938582.553969:0:16104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 874 00000100:00100000:3.0:1784938582.553982:0:16104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:12805:x1871643342488832:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:3.0:1784938582.554031:0:16104:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:191 count 1 00010000:00010000:3.0:1784938582.554070:0:16104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.554117:0:16104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009440a6e6/0xcd9d312a94a05ec7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5338 expref: 31 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.554127:0:16104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1784938582.554134:0:16104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.554140:0:16104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.554395:0:16104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009440a6e6/0xcd9d312a94a05ec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5338 expref: 31 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.554422:0:16104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009440a6e6/0xcd9d312a94a05ec7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5338 expref: 31 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.554444:0:16104:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:16104:1871643342489216:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938582.554600:0:16104:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460935fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938582.554658:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342488576:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938582.554714:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342489088:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938582.555070:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601c21880/2, rc 0, transno 4294967541 00000100:00100000:3.0:1784938582.555098:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342487296:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938582.555123:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601c22a00/2, rc 0, transno 4294967535 00000100:00100000:3.0:1784938582.555138:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342483968:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938582.555169:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938582.555838:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938582.555881:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938582.556019:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342488576 00000100:00100000:0.0:1784938582.556026:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342488576 00000100:00100000:0.0:1784938582.556083:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342489088 00000100:00100000:0.0:1784938582.556087:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342489088 00000100:00100000:0.0:1784938582.556111:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 875 00000100:00100000:1.0:1784938582.556123:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 876 00000100:00100000:0.0:1784938582.556126:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:12805:x1871643342488704:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938582.556130:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:12803:x1871643342488576:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938582.556154:0:19389:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:180 count 1 00002000:00080000:0.0:1784938582.556154:0:19388:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:182 count 1 00010000:00010000:1.0:1784938582.556178:0:19389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.556178:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.556199:0:19389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a05b94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51fd expref: 26 pid: 19399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.556199:0:19388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000fdf367/0xcd9d312a94a05eff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d532a expref: 31 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.556210:0:19389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb4:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1784938582.556210:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb6:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1784938582.556215:0:19389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.556215:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938582.556221:0:19389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 4/0,1 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.556221:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.556254:0:19389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a05b94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51fd expref: 26 pid: 19399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.556254:0:19388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000fdf367/0xcd9d312a94a05eff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d532a expref: 31 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.556269:0:19389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a05b94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51fd expref: 26 pid: 19399 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.556269:0:19388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000fdf367/0xcd9d312a94a05eff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d532a expref: 31 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938582.556285:0:19389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19389:1871643342489472:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938582.556290:0:19388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19388:1871643342489600:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938582.556366:0:19389:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473bb1ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938582.556641:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342488960:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938582.558383:0:19397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 877 00000100:00100000:2.0:1784938582.558406:0:19397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:12803:x1871643342489088:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938582.558441:0:19397:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:172 count 1 00002000:00010000:2.0:1784938582.558496:0:19397:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xac:0x0] initial LVB size: 4218, mtime: 0x6a640014, atime: 0x0, ctime: 0x6a640014, blocks: 0x13 00010000:00010000:2.0:1784938582.558503:0:19397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070df80e6/0xcd9d312a94a06a35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.558519:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xac:0x0].0x0 since=736s v=(0 0) 00010000:00010000:2.0:1784938582.558523:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.558530:0:19397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070df80e6/0xcd9d312a94a06a35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.558543:0:19397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070df80e6/0xcd9d312a94a06a35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.558554:0:19397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070df80e6/0xcd9d312a94a06a35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.558561:0:19397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070df80e6/0xcd9d312a94a06a35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.558577:0:19397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938582.559037:0:19388:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746044c2240 going to sleep for 11 seconds 00010000:00010000:1.0:1784938582.561894:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938582.561908:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070df80e6/0xcd9d312a94a06a35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.561922:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938582.561927:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070df80e6/0xcd9d312a94a06a35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.562148:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070df80e6/0xcd9d312a94a06a35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.562169:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070df80e6/0xcd9d312a94a06a35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.562177:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070df80e6/0xcd9d312a94a06a35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.562207:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938582.562208:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938582.562210:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938582.562242:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938582.562250:0:19397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:12803:x1871643342489088:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 3850us (6364us total) trans 4294967546 rc 0/0 00000100:00100000:2.0:1784938582.562258:0:19397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 877 00000100:00100000:1.0:1784938582.562260:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342489344:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938582.562440:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938582.562525:0:19399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342489344 00000100:00100000:0.0:1784938582.562533:0:19399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342489344 00000100:00100000:0.0:1784938582.562572:0:19399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 878 00000100:00100000:0.0:1784938582.562581:0:19399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+21:12805:x1871643342489344:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:0.0:1784938582.562608:0:19399:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:196 count 1 00002000:00010000:0.0:1784938582.562640:0:19399:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc4:0x0] initial LVB size: 1179443, mtime: 0x6a640017, atime: 0x0, ctime: 0x6a640017, blocks: 0x1007 00010000:00010000:0.0:1784938582.562647:0:19399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060688b63/0xcd9d312a94a06a3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.562661:0:19399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1784938582.562665:0:19399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.562672:0:19399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060688b63/0xcd9d312a94a06a3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.562685:0:19399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060688b63/0xcd9d312a94a06a3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.562693:0:19399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060688b63/0xcd9d312a94a06a3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.562700:0:19399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060688b63/0xcd9d312a94a06a3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.562726:0:19399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938582.563317:0:19399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+22:12805:x1871643342489344:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 735us (875us total) trans 4294967547 rc 0/0 00000100:00100000:0.0:1784938582.563325:0:19399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 878 00010000:00010000:2.0:1784938582.563665:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938582.563672:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060688b63/0xcd9d312a94a06a3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.563693:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148b600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938582.563698:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060688b63/0xcd9d312a94a06a3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.563706:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060688b63/0xcd9d312a94a06a3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.563721:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060688b63/0xcd9d312a94a06a3c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.563728:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060688b63/0xcd9d312a94a06a3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.563767:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938582.563769:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938582.563771:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784938582.564408:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e4a80/2, rc 0, transno 4294967546 00000100:00100000:3.0:1784938582.564449:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342489088:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938582.564536:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342489728:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938582.565110:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000004:00080000:2.0:1784938582.565883:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974607d60a80/2, rc 0, transno 4294967540 00000100:00100000:2.0:1784938582.570120:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342487552:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:2.0:1784938582.570179:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9746047bed80/2, rc 0, transno 4294967544 00000100:00100000:2.0:1784938582.570192:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342487424:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:2.0:1784938582.570206:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97473f605f80/2, rc 0, transno 4294967545 00000100:00100000:2.0:1784938582.570210:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342486656:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:2.0:1784938582.570220:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97473f605180/2, rc 0, transno 4294967539 00000100:00100000:2.0:1784938582.570241:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342486528:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938582.573138:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9746047bdc00/2, rc 0, transno 4294967542 00000100:00100000:3.0:1784938582.573170:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342487680:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938582.573203:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97473f604e00/2, rc 0, transno 4294967540 00000100:00100000:3.0:1784938582.573207:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342486400:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938582.573223:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e6680/2, rc 0, transno 4294967538 00000100:00100000:3.0:1784938582.573227:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342487168:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938582.573288:0:15285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326023040 00000100:00100000:3.0:1784938582.573297:0:15285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326023040 00010000:00010000:3.0:1784938582.573355:0:15285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009440a6e6/0xcd9d312a94a05ec7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5338 expref: 32 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938582.573373:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9747358f9180/2, rc 0, transno 4294967539 00000100:00100000:2.0:1784938582.573393:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342484480:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938582.573415:0:15285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 365 00000100:00100000:3.0:1784938582.573427:0:15285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+32:10024:x1871643326023040:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938582.573451:0:15285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938582.573459:0:15285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009440a6e6/0xcd9d312a94a05ec7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5338 expref: 32 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.573475:0:15285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009440a6e6/0xcd9d312a94a05ec7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5338 expref: 32 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.573539:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.573546:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.573553:0:15285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.573566:0:15285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.573590:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342489856:192.168.202.104@tcp:6:osp-syn-0-0.0 00010000:00010000:3.0:1784938582.573612:0:15285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938582.573681:0:15285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+32:10024:x1871643326023040:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 252us (8570us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938582.573684:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342490368:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938582.573702:0:15285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 365 00000100:00100000:2.0:1784938582.573733:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938582.573745:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342489984:192.168.202.104@tcp:6:osp-syn-0-0.0 00010000:00010000:3.0:1784938582.573802:0:16104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009440a6e6/0xcd9d312a94a05ec7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5338 expref: 31 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.573825:0:16104:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:16104:1871643342489216:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938582.573853:0:16104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.573877:0:16104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.573886:0:16104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.573912:0:16104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.573921:0:16104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.574046:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1784938582.574112:0:16104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938582.574238:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938582.574262:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938582.574313:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938582.574345:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326023168 00000100:00100000:2.0:1784938582.574353:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326023168 00010000:00010000:2.0:1784938582.574395:0:19391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a05b94 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51fd expref: 27 pid: 19399 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.574434:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326023296 00000100:00100000:2.0:1784938582.574438:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326023296 00010000:00010000:2.0:1784938582.574457:0:19391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000fdf367/0xcd9d312a94a05eff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d532a expref: 31 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.574483:0:19391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 366 00000100:00100000:2.0:1784938582.574492:0:19391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+27:10024:x1871643326023168:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938582.574506:0:19391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938582.574531:0:19391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a05b94 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51fd expref: 27 pid: 19399 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.574544:0:19391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a05b94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51fd expref: 27 pid: 19399 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.574575:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.574579:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.574586:0:19391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.574595:0:19391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.574617:0:19391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938582.574659:0:19391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+27:10024:x1871643326023168:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 166us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938582.574667:0:19391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 366 00000100:00100000:2.0:1784938582.574691:0:19391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 367 00000100:00100000:2.0:1784938582.574700:0:19391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+31:10026:x1871643326023296:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938582.574709:0:19391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938582.574716:0:19391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000fdf367/0xcd9d312a94a05eff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d532a expref: 31 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.574728:0:19391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000fdf367/0xcd9d312a94a05eff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d532a expref: 31 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.574790:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.574794:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.574799:0:19391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.574807:0:19391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.574819:0:19391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938582.574842:0:19391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+31:10026:x1871643326023296:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 144us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938582.574848:0:19391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 367 00000100:00100000:2.0:1784938582.574897:0:19393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342489856 00000100:00100000:2.0:1784938582.574902:0:19393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342489856 00000100:00100000:2.0:1784938582.574930:0:19393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342489984 00000100:00100000:2.0:1784938582.574933:0:19393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342489984 00000100:00100000:2.0:1784938582.574953:0:19393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 879 00000100:00100000:2.0:1784938582.574959:0:19393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:12802:x1871643342489856:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938582.574985:0:19393:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:189 count 1 00010000:00010000:2.0:1784938582.575008:0:19393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.575023:0:19393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc642a13/0xcd9d312a94a05f0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f9 expref: 26 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.575029:0:19393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbd:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1784938582.575039:0:19393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.575043:0:19393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.575070:0:19393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc642a13/0xcd9d312a94a05f0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f9 expref: 26 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.575084:0:19393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc642a13/0xcd9d312a94a05f0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f9 expref: 26 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.575100:0:19393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704026d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:19393:1871643342490496:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938582.575151:0:19393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747056e99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938582.575171:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 880 00000100:00100000:2.0:1784938582.575178:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:12802:x1871643342489984:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938582.575191:0:19390:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:199 count 1 00010000:00010000:2.0:1784938582.575204:0:19390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.575214:0:19390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a05ef8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d530e expref: 26 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.575221:0:19390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1784938582.575223:0:19390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.575226:0:19390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.575255:0:19390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a05ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d530e expref: 26 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.575264:0:19390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a05ef8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d530e expref: 26 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.575274:0:19390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704026a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:19390:1871643342490624:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938582.575297:0:19390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747056e96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938582.575413:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342490112:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938582.575454:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938582.575462:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342490240:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938582.575561:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938582.575585:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938582.575607:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342490112 00000100:00100000:2.0:1784938582.575612:0:19396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342490112 00000100:00100000:2.0:1784938582.575639:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342490240 00000100:00100000:2.0:1784938582.575641:0:19396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342490240 00000100:00100000:2.0:1784938582.575659:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 881 00000100:00100000:2.0:1784938582.575666:0:19396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:12804:x1871643342490112:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938582.575680:0:19396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:192 count 1 00010000:00010000:2.0:1784938582.575691:0:19396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.575704:0:19396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000313270bf/0xcd9d312a94a05f14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5315 expref: 26 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.575718:0:19396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc0:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1784938582.575721:0:19396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.575725:0:19396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.575746:0:19396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000313270bf/0xcd9d312a94a05f14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5315 expref: 26 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.575779:0:19396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000313270bf/0xcd9d312a94a05f14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5315 expref: 26 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.575789:0:19396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735400380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:19396:1871643342490752:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938582.575819:0:19396:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747056e93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938582.575838:0:19395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 882 00000100:00100000:2.0:1784938582.575846:0:19395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:12804:x1871643342490240:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938582.575861:0:19395:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:193 count 1 00000100:00100000:3.0:1784938582.577818:0:16104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:12805:x1871643342488832:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 23822us (25283us total) trans 4294967541 rc 0/0 00000100:00100000:3.0:1784938582.577837:0:16104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 874 00010000:00010000:0.0:1784938582.580033:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938582.580052:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.580065:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.580069:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.580080:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.580101:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.580109:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06a20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.580136:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.580138:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.580157:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.580227:0:19388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000fdf367/0xcd9d312a94a05eff lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d532a expref: 30 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.580242:0:19388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19388:1871643342489600:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938582.580266:0:19388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.580276:0:19388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.580281:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.580291:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.580298:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.580331:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938582.581362:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:12805:x1871643342488704:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 25238us (28793us total) trans 4294967542 rc 0/0 00000100:00100000:0.0:1784938582.581375:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 875 00010000:00010000:1.0:1784938582.582597:0:19389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a05b94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d51fd expref: 26 pid: 19399 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938582.582617:0:19389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19389:1871643342489472:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938582.582639:0:19389:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.582650:0:19389:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.582723:0:19389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.582736:0:19389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.582745:0:19389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.582809:0:19389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938582.582914:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938582.582942:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.582958:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148ba00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938582.582964:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.582976:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.583003:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.583012:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06a27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.583055:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938582.583061:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.583068:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938582.583072:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.583082:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.583097:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.583104:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a06a2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.583121:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938582.583123:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938582.583125:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938582.583550:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:12803:x1871643342488576:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 27418us (27716us total) trans 4294967548 rc 0/0 00000100:00100000:1.0:1784938582.583560:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 876 00000004:00080000:0.0:1784938582.583827:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974704025180/2, rc 0, transno 4294967542 00000100:00100000:0.0:1784938582.583843:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342488704:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938582.583946:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00010000:00010000:2.0:1784938582.583957:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938582.583966:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000004:00080000:2.0:1784938582.583979:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e4700/2, rc 0, transno 4294967548 00000100:00100000:2.0:1784938582.583990:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342488576:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938582.584173:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938582.584229:0:19397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342488960 00000100:00100000:2.0:1784938582.584236:0:19397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342488960 00000100:00100000:2.0:1784938582.584274:0:19397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342490368 00000100:00100000:2.0:1784938582.584277:0:19397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342490368 00000100:00100000:2.0:1784938582.584290:0:19397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342489728 00000100:00100000:2.0:1784938582.584296:0:19397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342489728 00000100:00100000:2.0:1784938582.584312:0:19397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 883 00000100:00100000:2.0:1784938582.584318:0:19397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+19:12803:x1871643342488960:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938582.584342:0:19397:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:188 count 1 00010000:00010000:2.0:1784938582.584357:0:19397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.584371:0:19397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa8b1e82/0xcd9d312a94a05ee3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d533f expref: 29 pid: 17487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.584377:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbc:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1784938582.584380:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.584383:0:19397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.584408:0:19397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa8b1e82/0xcd9d312a94a05ee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d533f expref: 29 pid: 17487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.584417:0:19397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa8b1e82/0xcd9d312a94a05ee3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d533f expref: 29 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.584428:0:19397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735401180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:19397:1871643342490880:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938582.584478:0:19397:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747056e9540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938582.584498:0:17487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 884 00000100:00100000:2.0:1784938582.584503:0:17487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:12802:x1871643342490368:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938582.584512:0:17487:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:166 count 1 00010000:00010000:2.0:1784938582.584526:0:17487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.584534:0:17487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a05f1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5331 expref: 25 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.584539:0:17487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa6:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1784938582.584541:0:17487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.584543:0:17487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 4/0,1 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.584556:0:17487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a05f1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5331 expref: 25 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.584562:0:17487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a05f1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5331 expref: 25 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.584568:0:17487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:17487:1871643342491008:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938582.584585:0:17487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747056e9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938582.584596:0:16104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 885 00000100:00100000:2.0:1784938582.584601:0:16104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473bab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:12805:x1871643342489728:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938582.584609:0:16104:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:188 count 1 00010000:00010000:2.0:1784938582.584616:0:16104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.584623:0:16104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cecd5a0b/0xcd9d312a94a05ef1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f2 expref: 25 pid: 17487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.584633:0:16104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbc:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1784938582.584635:0:16104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.584638:0:16104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.584650:0:16104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cecd5a0b/0xcd9d312a94a05ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f2 expref: 25 pid: 17487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.584656:0:16104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cecd5a0b/0xcd9d312a94a05ef1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f2 expref: 25 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.584666:0:16104:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:16104:1871643342491136:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938582.584690:0:16104:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747360933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938582.584742:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342491264:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:1.0:1784938582.584815:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974704027100/2, rc 0, transno 4294967541 00000100:00100000:1.0:1784938582.584821:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342488832:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:1.0:1784938582.584835:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e4380/2, rc 0, transno 4294967547 00000100:00100000:1.0:1784938582.584843:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342489344:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938582.585284:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00010000:00010000:2.0:1784938582.585307:0:19395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.585321:0:19395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0db1377/0xcd9d312a94a05ec0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d531c expref: 25 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.585328:0:19395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc1:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1784938582.585331:0:19395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.585335:0:19395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.585362:0:19395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d0db1377/0xcd9d312a94a05ec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d531c expref: 25 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.585372:0:19395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d0db1377/0xcd9d312a94a05ec0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d531c expref: 25 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.585382:0:19395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:19395:1871643342491392:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938582.585430:0:19395:0:(client.c:2702:ptlrpc_set_wait()) set ffff974736093600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938582.586044:0:19398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342491264 00000100:00100000:2.0:1784938582.586052:0:19398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342491264 00000100:00100000:2.0:1784938582.586095:0:19398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 886 00000100:00100000:2.0:1784938582.586104:0:19398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+28:12803:x1871643342491264:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938582.586130:0:19398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:191 count 1 00010000:00010000:2.0:1784938582.586150:0:19398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.586163:0:19398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a05f06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5346 expref: 25 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.586170:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbf:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1784938582.586174:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938582.586179:0:19398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.586215:0:19398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a05f06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5346 expref: 25 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.586226:0:19398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a05f06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5346 expref: 25 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.586239:0:19398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19398:1871643342491520:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938582.586285:0:19398:0:(client.c:2702:ptlrpc_set_wait()) set ffff974710404300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938582.589961:0:19390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704026a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:19390:1871643342490624:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938582.590004:0:19390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.591560:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938582.591609:0:15285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326023424 00000100:00100000:3.0:1784938582.591622:0:15285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326023424 00010000:00010000:3.0:1784938582.591679:0:15285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc642a13/0xcd9d312a94a05f0d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f9 expref: 26 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.591746:0:15285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 368 00000100:00100000:3.0:1784938582.591782:0:15285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+26:10025:x1871643326023424:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938582.591803:0:15285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938582.591809:0:15285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc642a13/0xcd9d312a94a05f0d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f9 expref: 26 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.591827:0:15285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc642a13/0xcd9d312a94a05f0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f9 expref: 26 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.591861:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.591876:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.591884:0:15285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.591896:0:15285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.591922:0:15285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938582.593033:0:19393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc642a13/0xcd9d312a94a05f0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f9 expref: 26 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.593057:0:19393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704026d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:19393:1871643342490496:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938582.593085:0:19393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.593102:0:19393:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.593109:0:19393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.593120:0:19393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.593129:0:19393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.593156:0:19393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938582.593342:0:15285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+25:10025:x1871643326023424:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1552us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938582.593358:0:15285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 368 00000100:00100000:3.0:1784938582.593477:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938582.593889:0:19393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:12802:x1871643342489856:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 18925us (19621us total) trans 4294967549 rc 0/0 00000100:00100000:0.0:1784938582.593902:0:19393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 879 00010000:00010000:3.0:1784938582.595834:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938582.595857:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.595903:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924ea00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938582.595909:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.595922:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.596921:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.597082:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d1d8f67/0xcd9d312a94a06a43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.597117:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938582.597119:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938582.597121:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938582.597149:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326023552 00000100:00100000:3.0:1784938582.597162:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326023552 00010000:00010000:3.0:1784938582.597215:0:19391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a05ef8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d530e expref: 25 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.597268:0:19391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 369 00000100:00100000:3.0:1784938582.597282:0:19391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+25:10023:x1871643326023552:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938582.597303:0:19391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938582.597310:0:19391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a05ef8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d530e expref: 25 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.597341:0:19391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a05ef8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d530e expref: 25 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.597361:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a05ef8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d530e expref: 25 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.597378:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.597383:0:19391:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.597389:0:19391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.597400:0:19391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.597436:0:19391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938582.597472:0:19390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.597499:0:19390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.597516:0:19390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.597518:0:19391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fcde919f-d270-4443-90d5-314650605a2d+24:10023:x1871643326023552:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 237us (4040us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938582.597539:0:19391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 369 00010000:00010000:1.0:1784938582.597567:0:19390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.597596:0:19390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938582.598011:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:12802:x1871643342489984:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 22827us (23692us total) trans 4294967550 rc 0/0 00000100:00100000:1.0:1784938582.598021:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 880 00010000:00010000:0.0:1784938582.598342:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938582.598353:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.598374:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924ee00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.598381:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.598391:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.598416:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.598423:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601e58ae/0xcd9d312a94a06a4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.598445:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.598447:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.598449:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938582.599269:0:19396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735400380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:19396:1871643342490752:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938582.599299:0:19396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.599431:0:19398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19398:1871643342491520:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938582.599450:0:19398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.599518:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938582.599561:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938582.599582:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326023680 00000100:00100000:0.0:1784938582.599590:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326023680 00000100:00100000:3.0:1784938582.599597:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1784938582.599623:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000313270bf/0xcd9d312a94a05f14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5315 expref: 24 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.599638:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000004:00080000:2.0:1784938582.600346:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974704025c00/2, rc 0, transno 4294967550 00000100:00100000:2.0:1784938582.600365:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342489984:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:2.0:1784938582.600377:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974704025500/2, rc 0, transno 4294967549 00000100:00100000:2.0:1784938582.600381:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342489856:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938582.600410:0:19397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735401180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:19397:1871643342490880:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938582.600429:0:19397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.600459:0:17487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:17487:1871643342491008:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938582.600477:0:17487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.600500:0:16104:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:16104:1871643342491136:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938582.600511:0:16104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938582.601253:0:19395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:19395:1871643342491392:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938582.601271:0:19395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938582.601565:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938582.602944:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326024192 00000100:00100000:0.0:1784938582.602969:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326024192 00010000:00010000:0.0:1784938582.603032:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a05f06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5346 expref: 25 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.603070:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326024064 00000100:00100000:0.0:1784938582.603073:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326024064 00010000:00010000:0.0:1784938582.603088:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d0db1377/0xcd9d312a94a05ec0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d531c expref: 26 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.603101:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326023936 00000100:00100000:0.0:1784938582.603108:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326023936 00010000:00010000:0.0:1784938582.603124:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a05f1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5331 expref: 27 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.603143:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 370 00000100:00100000:0.0:1784938582.603157:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974710d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+27:10024:x1871643326023680:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938582.603176:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938582.603185:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000313270bf/0xcd9d312a94a05f14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5315 expref: 27 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.603220:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000313270bf/0xcd9d312a94a05f14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5315 expref: 27 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.603253:0:17728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000313270bf/0xcd9d312a94a05f14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5315 expref: 27 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.603269:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.603273:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.603282:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.603292:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.603330:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938582.603409:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974710d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+26:10024:x1871643326023680:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 255us (3898us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938582.603417:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 370 00000100:00100000:0.0:1784938582.603477:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 371 00000100:00100000:0.0:1784938582.603486:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+25:10024:x1871643326024192:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938582.603499:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938582.603504:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a05f06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5346 expref: 25 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.603527:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a05f06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5346 expref: 25 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604570:0:17728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a05f06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5346 expref: 25 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604586:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.604590:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.604595:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604604:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604637:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938582.604682:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+24:10024:x1871643326024192:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1196us (5125us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938582.604694:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 371 00000100:00100000:0.0:1784938582.604722:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 372 00000100:00100000:0.0:1784938582.604729:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+23:10024:x1871643326024064:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938582.604740:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938582.604745:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d0db1377/0xcd9d312a94a05ec0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d531c expref: 23 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604789:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d0db1377/0xcd9d312a94a05ec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d531c expref: 23 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604802:0:17728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0db1377/0xcd9d312a94a05ec0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d531c expref: 23 pid: 19395 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604810:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.604813:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.604817:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604824:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604842:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938582.604858:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+22:10024:x1871643326024064:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 130us (5263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938582.604874:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 372 00000100:00100000:0.0:1784938582.604887:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 373 00000100:00100000:0.0:1784938582.604894:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+21:10026:x1871643326023936:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938582.604904:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938582.604910:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a05f1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5331 expref: 21 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604930:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a05f1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5331 expref: 21 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604942:0:17728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a05f1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5331 expref: 21 pid: 19394 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604951:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.604954:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.604958:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604966:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.604989:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938582.605010:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+20:10026:x1871643326023936:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 116us (5379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938582.605017:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 373 00010000:00010000:0.0:1784938582.605051:0:19398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.605061:0:19398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.605071:0:19398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.605085:0:19398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.605100:0:19398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938582.605511:0:19398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+29:12803:x1871643342491264:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 19407us (20227us total) trans 4294967551 rc 0/0 00000100:00100000:0.0:1784938582.605516:0:19398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 886 00010000:00010000:0.0:1784938582.605532:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938582.605537:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.605543:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924e400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.605546:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.605553:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.605562:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.605566:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06a74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.605580:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.605586:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.605587:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.605983:0:19396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.605994:0:19396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.606002:0:19396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.606010:0:19396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.606024:0:19396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938582.606407:0:19396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:12804:x1871643342490112:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 30738us (30843us total) trans 4294967552 rc 0/0 00000100:00100000:0.0:1784938582.606415:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 881 00000100:00100000:3.0:1784938582.608815:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938582.608818:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326023808 00000100:00100000:0.0:1784938582.608833:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326023808 00010000:00010000:0.0:1784938582.609199:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa8b1e82/0xcd9d312a94a05ee3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d533f expref: 30 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.609241:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326024320 00000100:00100000:0.0:1784938582.609246:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326024320 00010000:00010000:0.0:1784938582.609266:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cecd5a0b/0xcd9d312a94a05ef1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f2 expref: 20 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.609307:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 374 00000100:00100000:0.0:1784938582.609316:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+30:10026:x1871643326023808:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938582.609332:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938582.609338:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa8b1e82/0xcd9d312a94a05ee3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d533f expref: 30 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.609351:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa8b1e82/0xcd9d312a94a05ee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d533f expref: 30 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.609374:0:17728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa8b1e82/0xcd9d312a94a05ee3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d533f expref: 30 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.609390:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.609394:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.609400:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.609409:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.609444:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938582.609493:0:19397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.609510:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+29:10026:x1871643326023808:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 192us (7948us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938582.609544:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 374 00010000:00010000:3.0:1784938582.609546:0:19397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.609570:0:19397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.609583:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 375 00000100:00100000:0.0:1784938582.609590:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+20:10026:x1871643326024320:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938582.609600:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938582.609605:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cecd5a0b/0xcd9d312a94a05ef1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f2 expref: 20 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.609616:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cecd5a0b/0xcd9d312a94a05ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f2 expref: 20 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.609630:0:17728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cecd5a0b/0xcd9d312a94a05ef1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d52f2 expref: 20 pid: 17487 timeout: 836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.609641:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938582.609647:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938582.609649:0:19397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.609654:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.609679:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.609690:0:19397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784938582.609706:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938582.609731:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+19:10026:x1871643326024320:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 141us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938582.609738:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 375 00000100:00100000:3.0:1784938582.611022:0:19397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:12803:x1871643342488960:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 26693us (27066us total) trans 4294967543 rc 0/0 00000100:00100000:3.0:1784938582.611037:0:19397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 883 00010000:00010000:3.0:1784938582.611089:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938582.611100:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.611113:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924fc00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938582.611119:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.611131:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.611154:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.611171:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003086b493/0xcd9d312a94a06a51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.611197:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938582.611202:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.611209:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938582.611213:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.611221:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.611233:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.611241:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.611256:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938582.611258:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938582.611260:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784938582.613370:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974609ea2300/2, rc 0, transno 4294967551 00000100:00100000:0.0:1784938582.613409:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342491264:192.168.202.104@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1784938582.613467:0:17487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.613483:0:17487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.613496:0:17487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.613505:0:17487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.613530:0:17487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938582.614309:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938582.614326:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.614343:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924e200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938582.614351:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.614365:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938582.614368:0:17487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:12802:x1871643342490368:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 29857us (30393us total) trans 4294967553 rc 0/0 00000100:00100000:0.0:1784938582.614406:0:17487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 884 00010000:00010000:1.0:1784938582.614419:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.614434:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e62ab2f/0xcd9d312a94a06a5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.614469:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784938582.614482:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974704026680/2, rc 0, transno 4294967543 00010000:00010000:1.0:1784938582.614486:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938582.614495:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938582.614509:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342488960:192.168.202.104@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1784938582.614516:0:19395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.614528:0:19395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.614539:0:19395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.614548:0:19395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938582.614570:0:19395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938582.614712:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938582.614722:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.614733:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924e600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938582.614738:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938582.615196:0:19395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:12804:x1871643342490240:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 39343us (39602us total) trans 4294967554 rc 0/0 00000100:00100000:1.0:1784938582.615208:0:19395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 882 00010000:00010000:0.0:1784938582.615633:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.615658:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.615667:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031c24a3e/0xcd9d312a94a06a6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938582.615703:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.615706:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938582.615709:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938582.616456:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938582.616474:0:16104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.616486:0:16104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.616496:0:16104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.616504:0:16104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938582.616534:0:16104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938582.616624:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938582.616639:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.616670:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924ec00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938582.616675:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.616686:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.616710:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.616717:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938582.616744:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938582.616746:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938582.616776:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938582.617656:0:16104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473bab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:12805:x1871643342489728:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 33047us (33476us total) trans 4294967555 rc 0/0 00000100:00100000:2.0:1784938582.617668:0:16104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 885 00000004:00080000:2.0:1784938582.617836:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974704025880/2, rc 0, transno 4294967553 00000100:00100000:2.0:1784938582.617850:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342490368:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:2.0:1784938582.617911:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974704026300/2, rc 0, transno 4294967554 00000100:00100000:2.0:1784938582.617925:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342490240:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:2.0:1784938582.617939:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974704027480/2, rc 0, transno 4294967552 00000100:00100000:2.0:1784938582.617943:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342490112:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:2.0:1784938582.618921:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e6d80/2, rc 0, transno 4294967555 00000100:00100000:2.0:1784938582.618943:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342489728:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938582.653217:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938582.653445:0:24721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326024576 00000100:00100000:1.0:1784938582.653462:0:24721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326024576 00000100:00100000:1.0:1784938582.653565:0:24721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:1.0:1784938582.653579:0:24721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcde919f-d270-4443-90d5-314650605a2d+7:10024:x1871643326024576:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938582.653673:0:24721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcde919f-d270-4443-90d5-314650605a2d+7:10024:x1871643326024576:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 98us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938582.653682:0:24721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00080000:3.0:1784938582.654513:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938582.655257:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938582.655334:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326024448 00000100:00100000:3.0:1784938582.655342:0:24715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326024448 00000100:00100000:3.0:1784938582.655410:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:3.0:1784938582.655418:0:24715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974740e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10026:x1871643326024448:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784938582.655488:0:24715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974740e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10026:x1871643326024448:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 71us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938582.655496:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 73 00010000:00010000:1.0:1784938582.899666:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784938583.411061:0:24745:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737248305527ns, next at 738248301766ns, rc = 0 00000100:00100000:0.0:1784938583.411118:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342491648:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938583.411532:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000004:00080000:2.0:1784938583.411722:0:24747:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737248969062ns, next at 738248967002ns, rc = 0 00000100:00100000:1.0:1784938583.412280:0:16106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342491648 00000100:00100000:1.0:1784938583.412293:0:16106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342491648 00000100:00100000:1.0:1784938583.412362:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 111 00000100:00100000:1.0:1784938583.412373:0:16106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:12804:x1871643342491648:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938583.412423:0:16106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43319296 pending 0 free 384827392 avail 382730240 00000100:00100000:1.0:1784938583.412487:0:16106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:12804:x1871643342491648:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 115us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938583.412496:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 111 00000100:00100000:0.0:1784938583.413456:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342491776:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938583.415375:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938583.415440:0:16107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342491776 00000100:00100000:1.0:1784938583.415452:0:16107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342491776 00000100:00100000:1.0:1784938583.415516:0:16107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 112 00000100:00100000:1.0:1784938583.415527:0:16107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+20:12805:x1871643342491776:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938583.415578:0:16107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43319296 pending 0 free 386924544 avail 384827392 00000100:00100000:1.0:1784938583.418153:0:16107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+20:12805:x1871643342491776:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 2609us (2773us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938583.418170:0:16107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 112 00000100:00100000:1.0:1784938583.418491:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342491776:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938583.418565:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342491648:192.168.202.104@tcp:13:osp-pre-0-0.0 00000001:00080000:1.0:1784938583.488234:0:16101:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967553 is committed 00000001:00080000:1.0:1784938583.488286:0:16101:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967554 is committed 00000001:00080000:1.0:1784938583.488319:0:16101:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967555 is committed 00000100:00100000:1.0:1784938583.923148:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66ce0d8a-9177-486f-adae-cb202cd372dd:12802:1871643342491904:0@lo:400:kworker.0 00000100:00100000:1.0:1784938583.923223:0:12802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938583.923280:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938583.923299:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342492032:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938583.923380:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:12804:1871643342492160:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938583.923420:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938583.923427:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342492288:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938583.923466:0:24739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342491904 00000100:00100000:1.0:1784938583.923474:0:24739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342491904 00000100:00100000:1.0:1784938583.923520:0:24739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784938583.923535:0:24739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974740e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12802:x1871643342491904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938583.923597:0:24739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974740e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12802:x1871643342491904:12345-0@lo:400:kworker.0 Request processed in 63us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938583.923605:0:24739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784938583.923832:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938583.923905:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938583.923926:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938583.923956:0:24721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342492160 00000100:00100000:1.0:1784938583.923960:0:24721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342492160 00000100:00100000:1.0:1784938583.923989:0:24721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342492032 00000100:00100000:1.0:1784938583.923992:0:24721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342492032 00000100:00100000:1.0:1784938583.924005:0:24721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342492288 00000100:00100000:1.0:1784938583.924007:0:24721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342492288 00000100:00100000:1.0:1784938583.924020:0:24721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 23 00000100:00100000:1.0:1784938583.924027:0:24721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12804:x1871643342492160:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938583.924063:0:24721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12804:x1871643342492160:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 36us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938583.924069:0:24721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 23 00000100:00100000:1.0:1784938583.924082:0:24721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 24 00000100:00100000:1.0:1784938583.924097:0:24721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342492032:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938583.924120:0:24721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342492032:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 24us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938583.924126:0:24721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 24 00000100:00100000:1.0:1784938583.924137:0:24721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 25 00000100:00100000:1.0:1784938583.924143:0:24721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342492288:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938583.924163:0:24721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342492288:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 20us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938583.924168:0:24721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 25 00000100:00080000:1.0:1784938583.924187:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938583.924724:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342492288:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938583.924745:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:12804:1871643342492160:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938583.924819:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342492032:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938583.924830:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66ce0d8a-9177-486f-adae-cb202cd372dd:12802:1871643342491904:0@lo:400:kworker.0 00010000:00010000:2.0:1784938583.926066:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784938584.086664:0:16955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967542 is committed 00000001:00080000:3.0:1784938584.086726:0:16955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967543 is committed 00010000:00010000:2.0:1784938584.947730:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938585.971102:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938586.999248:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784938587.611147:0:24729:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:0.0:1784938587.611186:0:24729:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:2.0:1784938587.611882:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342492544:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938587.612013:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342493056:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938587.612047:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342493568:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938587.612071:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472ff21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342494080:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938587.612098:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1784938587.612104:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342492416:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938587.612126:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342492928:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938587.612146:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342493440:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938587.612166:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472ff20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342493952:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938587.612568:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938587.612638:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938587.612659:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938587.612681:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938587.612698:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938587.612716:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938587.612740:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938587.612800:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938587.612837:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342492544 00000100:00100000:3.0:1784938587.612847:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342492544 00000100:00100000:3.0:1784938587.612906:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342493056 00000100:00100000:3.0:1784938587.612910:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342493056 00000100:00100000:3.0:1784938587.612926:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342493568 00000100:00100000:3.0:1784938587.612928:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342493568 00000100:00100000:3.0:1784938587.612944:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342494080 00000100:00100000:3.0:1784938587.612947:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342494080 00000100:00100000:3.0:1784938587.612961:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342492416 00000100:00100000:3.0:1784938587.612964:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342492416 00000100:00100000:3.0:1784938587.612978:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342492928 00000100:00100000:3.0:1784938587.612980:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342492928 00000100:00100000:3.0:1784938587.612993:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342493440 00000100:00100000:3.0:1784938587.612996:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342493440 00000100:00100000:3.0:1784938587.613012:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342493952 00000100:00100000:3.0:1784938587.613014:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342493952 00000100:00100000:3.0:1784938587.613033:0:16102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 887 00000100:00100000:3.0:1784938587.613041:0:16102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:12803:x1871643342492544:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:3.0:1784938587.613076:0:16102:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:174 count 1 00010000:00010000:3.0:1784938587.613105:0:16102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.613151:0:16102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a2301ac/0xcd9d312a94a06025 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5362 expref: 28 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.613160:0:16102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1784938587.613164:0:16102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.613170:0:16102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.613358:0:16102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a2301ac/0xcd9d312a94a06025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5362 expref: 28 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.613374:0:16102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a2301ac/0xcd9d312a94a06025 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5362 expref: 28 pid: 19394 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.613388:0:16102:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:16102:1871643342494464:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938587.613454:0:16102:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938587.613479:0:19405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 888 00000100:00100000:3.0:1784938587.613487:0:19405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+8:12803:x1871643342493056:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:3.0:1784938587.613501:0:19405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:172 count 1 00010000:00010000:3.0:1784938587.613515:0:19405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.613529:0:19405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da0da745/0xcd9d312a94a06159 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5385 expref: 28 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.613548:0:19405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1784938587.613551:0:19405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.613555:0:19405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.613576:0:19405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da0da745/0xcd9d312a94a06159 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5385 expref: 28 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.613586:0:19405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da0da745/0xcd9d312a94a06159 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5385 expref: 28 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.613597:0:19405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603682a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:19405:1871643342494592:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938587.613625:0:19405:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938587.613645:0:19392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 889 00000100:00100000:3.0:1784938587.613652:0:19392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:12803:x1871643342493568:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938587.613668:0:19392:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:185 count 1 00010000:00010000:3.0:1784938587.613686:0:19392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.613699:0:19392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a05eea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d535b expref: 18 pid: 17487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.613707:0:19392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb9:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1784938587.613710:0:19392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.613720:0:19392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.613741:0:19392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a05eea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d535b expref: 18 pid: 17487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938587.614370:0:16105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 890 00000100:00100000:2.0:1784938587.614382:0:16105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601de5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:12803:x1871643342494080:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938587.614400:0:16105:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:164 count 1 00010000:00010000:2.0:1784938587.614424:0:16105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.614440:0:16105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009fc87998/0xcd9d312a94a061de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53c4 expref: 18 pid: 17487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.614448:0:16105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa4:0x0].0x0 since=10s v=(0 0) 00010000:00010000:2.0:1784938587.614451:0:16105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938587.614455:0:16105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.614478:0:16105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009fc87998/0xcd9d312a94a061de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53c4 expref: 18 pid: 17487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.614489:0:16105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009fc87998/0xcd9d312a94a061de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53c4 expref: 18 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938587.614501:0:16105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:16105:1871643342494848:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938587.614545:0:16105:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460935f240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938587.614564:0:19394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 891 00000100:00100000:2.0:1784938587.614573:0:19394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601de4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:12803:x1871643342492416:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938587.614588:0:19394:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:169 count 1 00010000:00010000:2.0:1784938587.614600:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.614612:0:19394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e01f7a01/0xcd9d312a94a05ece lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5354 expref: 28 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.614626:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=10s v=(0 0) 00010000:00010000:2.0:1784938587.614630:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938587.614634:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.614655:0:19394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e01f7a01/0xcd9d312a94a05ece lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5354 expref: 28 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.614665:0:19394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e01f7a01/0xcd9d312a94a05ece lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5354 expref: 28 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938587.614676:0:19394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:19394:1871643342494976:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938587.614702:0:19394:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460935f300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938587.614723:0:16104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 892 00000100:00100000:2.0:1784938587.614731:0:16104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:12803:x1871643342492928:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938587.614745:0:16104:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:173 count 1 00010000:00010000:2.0:1784938587.614791:0:16104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.614805:0:16104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8818ac0/0xcd9d312a94a06160 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d537e expref: 28 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.614812:0:16104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=10s v=(0 0) 00010000:00010000:2.0:1784938587.614815:0:16104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938587.614838:0:16104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 4/0,1 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.614861:0:16104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8818ac0/0xcd9d312a94a06160 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d537e expref: 28 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.614871:0:16104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8818ac0/0xcd9d312a94a06160 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d537e expref: 28 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938587.614881:0:16104:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:16104:1871643342495104:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938587.614907:0:16104:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460935f3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784938587.615279:0:19392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a05eea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d535b expref: 18 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.615293:0:19392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19392:1871643342494720:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938587.615338:0:19392:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21af00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938587.615361:0:19397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 893 00000100:00100000:3.0:1784938587.615371:0:19397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+8:12803:x1871643342493440:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938587.615387:0:19397:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:195 count 1 00010000:00010000:3.0:1784938587.615399:0:19397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.615409:0:19397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a05f22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d534d expref: 18 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.615416:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1784938587.615419:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.615422:0:19397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.615440:0:19397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a05f22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d534d expref: 18 pid: 19394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.615459:0:19397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a05f22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d534d expref: 18 pid: 19394 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.615469:0:19397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:19397:1871643342495232:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938587.615492:0:19397:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938587.616303:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 894 00000100:00100000:2.0:1784938587.616319:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:12803:x1871643342493952:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938587.616338:0:19389:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:194 count 1 00010000:00010000:2.0:1784938587.616353:0:19389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.616367:0:19389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a061ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53af expref: 18 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.616375:0:19389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=10s v=(0 0) 00010000:00010000:2.0:1784938587.616378:0:19389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938587.616381:0:19389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.616405:0:19389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a061ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53af expref: 18 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.616424:0:19389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a061ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53af expref: 18 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784938587.616429:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938587.616434:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938587.616436:0:19389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19389:1871643342495360:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938587.616483:0:19389:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460935fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938587.616528:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342492800:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938587.616621:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342493312:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938587.618977:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472ff22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342493824:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938587.623111:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938587.623210:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938587.623465:0:19395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342492800 00000100:00100000:1.0:1784938587.623475:0:19395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342492800 00000100:00100000:1.0:1784938587.623530:0:19395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342493312 00000100:00100000:1.0:1784938587.623533:0:19395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342493312 00000100:00100000:1.0:1784938587.623556:0:19395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 895 00000100:00100000:1.0:1784938587.623565:0:19395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:12805:x1871643342492800:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938587.623619:0:19395:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:198 count 1 00010000:00010000:1.0:1784938587.623647:0:19395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.623669:0:19395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0617c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5377 expref: 28 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.623677:0:19395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=10s v=(0 0) 00010000:00010000:1.0:1784938587.623681:0:19395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.623685:0:19395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.623720:0:19395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0617c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5377 expref: 28 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.623733:0:19395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0617c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5377 expref: 28 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.623748:0:19395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:19395:1871643342495488:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938587.623874:0:19395:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055a0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938587.623875:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 896 00000100:00100000:0.0:1784938587.623885:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:12805:x1871643342493312:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938587.623910:0:19390:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:185 count 1 00010000:00010000:0.0:1784938587.623924:0:19390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.623941:0:19390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a061bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53bd expref: 28 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.623948:0:19390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb9:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.623951:0:19390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.623954:0:19390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 4/0,1 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.623974:0:19390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a061bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53bd expref: 28 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.623984:0:19390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a061bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53bd expref: 28 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.623997:0:19390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:19390:1871643342495616:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.624037:0:19390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746028c6840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938587.625976:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342492672:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.626054:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342493184:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.626080:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472ff20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342493696:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938587.626110:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472ff21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342494208:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938587.626417:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938587.626445:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938587.626466:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938587.626493:0:19398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342492672 00000100:00100000:1.0:1784938587.626501:0:19398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342492672 00000100:00100000:1.0:1784938587.626545:0:19398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342493184 00000100:00100000:1.0:1784938587.626562:0:19398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342493184 00000100:00100000:1.0:1784938587.626581:0:19398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342493696 00000100:00100000:1.0:1784938587.626583:0:19398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342493696 00000100:00100000:1.0:1784938587.626602:0:19398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 897 00000100:00100000:1.0:1784938587.626610:0:19398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+12:12804:x1871643342492672:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938587.626641:0:19398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:167 count 1 00010000:00010000:1.0:1784938587.626668:0:19398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.626671:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00010000:00010000:1.0:1784938587.626689:0:19398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008bea93d3/0xcd9d312a94a0616e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5370 expref: 28 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.626698:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=10s v=(0 0) 00010000:00010000:1.0:1784938587.626703:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.626708:0:19398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.626739:0:19398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008bea93d3/0xcd9d312a94a0616e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5370 expref: 28 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.626912:0:19398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008bea93d3/0xcd9d312a94a0616e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5370 expref: 28 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.626928:0:19398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19398:1871643342495744:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938587.626979:0:19398:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718088300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938587.626995:0:19399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342494208 00000100:00100000:1.0:1784938587.626999:0:19399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342494208 00000100:00100000:1.0:1784938587.627027:0:19399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 898 00000100:00100000:1.0:1784938587.627034:0:19399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+12:12804:x1871643342493184:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938587.627048:0:19399:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:186 count 1 00010000:00010000:1.0:1784938587.627060:0:19399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.627084:0:19399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039cbf935/0xcd9d312a94a06167 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d539a expref: 28 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.627090:0:19399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xba:0x0].0x0 since=10s v=(0 0) 00010000:00010000:1.0:1784938587.627093:0:19399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.627097:0:19399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.627117:0:19399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039cbf935/0xcd9d312a94a06167 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d539a expref: 28 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.627126:0:19399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039cbf935/0xcd9d312a94a06167 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d539a expref: 28 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.627136:0:19399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:19399:1871643342495872:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938587.627160:0:19399:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718088b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938587.627179:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 899 00000100:00100000:2.0:1784938587.627299:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974707fb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342494336:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938587.627993:0:19396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:12804:x1871643342493696:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938587.628018:0:19396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:171 count 1 00010000:00010000:1.0:1784938587.628047:0:19396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.628107:0:19396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a06175 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d538c expref: 18 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.628116:0:19396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xab:0x0].0x0 since=10s v=(0 0) 00010000:00010000:1.0:1784938587.628119:0:19396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.628123:0:19396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 4/0,1 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.628148:0:19396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a06175 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d538c expref: 18 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.628159:0:19396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a06175 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d538c expref: 18 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.628171:0:19396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:19396:1871643342496000:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.628262:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938587.628285:0:19396:0:(client.c:2702:ptlrpc_set_wait()) set ffff974713587d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938587.628302:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342493824 00000100:00100000:1.0:1784938587.628308:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342493824 00000100:00100000:0.0:1784938587.628328:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938587.628332:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342494336 00000100:00100000:1.0:1784938587.628334:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342494336 00000100:00100000:1.0:1784938587.628349:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 900 00000100:00100000:1.0:1784938587.628355:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:12804:x1871643342494208:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938587.628369:0:19388:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:168 count 1 00010000:00010000:1.0:1784938587.628381:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.628400:0:19388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a061f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53cb expref: 18 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.628406:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa8:0x0].0x0 since=10s v=(0 0) 00010000:00010000:1.0:1784938587.628409:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.628413:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.628435:0:19388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a061f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53cb expref: 18 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.628445:0:19388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a061f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53cb expref: 18 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.628456:0:19388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19388:1871643342496128:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938587.628480:0:19388:0:(client.c:2702:ptlrpc_set_wait()) set ffff974702ec8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938587.640421:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.640509:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.640565:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.640591:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.640674:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.640691:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.640705:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938587.641000:0:16102:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:16102:1871643342494464:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938587.641029:0:16102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.641063:0:15285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326024704 00000100:00100000:1.0:1784938587.641070:0:15285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326024704 00010000:00010000:1.0:1784938587.641118:0:15285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a2301ac/0xcd9d312a94a06025 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5362 expref: 29 pid: 19394 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.641154:0:15285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326025216 00000100:00100000:1.0:1784938587.641157:0:15285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326025216 00010000:00010000:1.0:1784938587.641174:0:15285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a05eea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d535b expref: 19 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.641187:0:15285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326025088 00000100:00100000:1.0:1784938587.641190:0:15285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326025088 00010000:00010000:1.0:1784938587.641201:0:15285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8818ac0/0xcd9d312a94a06160 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d537e expref: 30 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.641213:0:15285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326024832 00000100:00100000:1.0:1784938587.641215:0:15285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326024832 00010000:00010000:1.0:1784938587.641226:0:15285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009fc87998/0xcd9d312a94a061de lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53c4 expref: 20 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.641236:0:15285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326025728 00000100:00100000:1.0:1784938587.641239:0:15285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326025728 00010000:00010000:1.0:1784938587.641249:0:15285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0617c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5377 expref: 31 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.641261:0:15285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326026240 00000100:00100000:1.0:1784938587.641263:0:15285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326026240 00010000:00010000:1.0:1784938587.641274:0:15285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a06175 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d538c expref: 21 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.641285:0:15285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326026112 00000100:00100000:1.0:1784938587.641293:0:15285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326026112 00010000:00010000:1.0:1784938587.641307:0:15285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039cbf935/0xcd9d312a94a06167 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d539a expref: 32 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.641324:0:15285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 376 00000100:00100000:1.0:1784938587.641332:0:15285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+32:10024:x1871643326024704:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1784938587.641343:0:19405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603682a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:19405:1871643342494592:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938587.641347:0:15285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938587.641352:0:15285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a2301ac/0xcd9d312a94a06025 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5362 expref: 32 pid: 19394 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.641358:0:19405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641364:0:15285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a2301ac/0xcd9d312a94a06025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5362 expref: 32 pid: 19394 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.641384:0:19397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:19397:1871643342495232:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938587.641391:0:15285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a2301ac/0xcd9d312a94a06025 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5362 expref: 32 pid: 19394 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.641395:0:19397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641408:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1784938587.641413:0:19392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19392:1871643342494720:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938587.641413:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.641418:0:15285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.641423:0:19392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641428:0:15285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641452:0:15285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938587.641465:0:16102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.641472:0:16102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.641491:0:16102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.641499:0:16102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.641499:0:15285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+31:10024:x1871643326024704:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 167us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938587.641510:0:15285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 376 00010000:00010000:3.0:1784938587.641515:0:16102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938587.641530:0:15285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 377 00000100:00100000:1.0:1784938587.641535:0:15285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974710d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+21:10024:x1871643326025216:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938587.641543:0:15285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938587.641547:0:15285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a05eea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d535b expref: 21 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641556:0:15285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a05eea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d535b expref: 21 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641570:0:15285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a05eea lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d535b expref: 21 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641579:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.641582:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.641586:0:15285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641593:0:15285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641608:0:15285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938587.641626:0:15285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974710d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+20:10024:x1871643326025216:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 91us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938587.641632:0:15285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 377 00000100:00100000:1.0:1784938587.641677:0:15285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 378 00000100:00100000:1.0:1784938587.641683:0:15285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+30:10024:x1871643326025088:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938587.641690:0:15285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938587.641695:0:15285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8818ac0/0xcd9d312a94a06160 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d537e expref: 30 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641704:0:15285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8818ac0/0xcd9d312a94a06160 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d537e expref: 30 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641717:0:15285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8818ac0/0xcd9d312a94a06160 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d537e expref: 30 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641726:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.641729:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.641734:0:15285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641743:0:15285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.641777:0:15285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938587.641797:0:15285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+29:10024:x1871643326025088:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 113us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938587.641802:0:15285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 378 00000100:00100000:1.0:1784938587.641816:0:15285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 379 00000100:00100000:1.0:1784938587.641822:0:15285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+19:10025:x1871643326024832:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938587.641848:0:15285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784938587.641996:0:16105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:16105:1871643342494848:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938587.642013:0:16105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938587.642041:0:19394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:19394:1871643342494976:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938587.642052:0:19394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938587.642077:0:19389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19389:1871643342495360:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938587.642088:0:19389:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938587.642123:0:15286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 380 00000100:00100000:2.0:1784938587.642131:0:15286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcde919f-d270-4443-90d5-314650605a2d+28:10024:x1871643326025728:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938587.642139:0:15286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938587.642145:0:15286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0617c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5377 expref: 28 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.642150:0:16104:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:16104:1871643342495104:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938587.642154:0:15286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0617c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5377 expref: 28 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.642164:0:16104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.642167:0:15286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938587.642171:0:15286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.642173:0:16104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.642176:0:15286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.642180:0:16104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.642188:0:16104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.642195:0:16104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.642213:0:16104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1784938587.642727:0:16104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:12803:x1871643342492928:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 27995us (30007us total) trans 4294967544 rc 0/0 00000100:00100000:0.0:1784938587.642746:0:16104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 892 00000100:00100000:0.0:1784938587.642791:0:16104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 901 00000100:00100000:0.0:1784938587.642800:0:16104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:12805:x1871643342493824:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1784938587.643290:0:15285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009fc87998/0xcd9d312a94a061de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53c4 expref: 19 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.643303:0:15285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009fc87998/0xcd9d312a94a061de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53c4 expref: 19 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.643321:0:15285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fc87998/0xcd9d312a94a061de lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53c4 expref: 19 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.643334:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.643338:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.643343:0:15285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.643351:0:15285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.643378:0:15285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938587.643407:0:15285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+18:10025:x1871643326024832:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 1585us (2814us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938587.643416:0:15285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 379 00000100:00100000:1.0:1784938587.643439:0:15285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 381 00000100:00100000:1.0:1784938587.643446:0:15285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+17:10024:x1871643326026240:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938587.643456:0:15285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938587.643468:0:15285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a06175 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d538c expref: 17 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.643477:0:15285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a06175 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d538c expref: 17 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.643488:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.643491:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.643495:0:15285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.643502:0:15285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.643512:0:15285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938587.643530:0:15285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+17:10024:x1871643326026240:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 86us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938587.643536:0:15285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 381 00000100:00100000:1.0:1784938587.643550:0:15285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 382 00000100:00100000:1.0:1784938587.643558:0:15285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+28:10024:x1871643326026112:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938587.643566:0:15285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938587.643571:0:15285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039cbf935/0xcd9d312a94a06167 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d539a expref: 28 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.643579:0:15285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039cbf935/0xcd9d312a94a06167 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d539a expref: 28 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.643603:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.643606:0:15285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.643610:0:15285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.643617:0:15285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.643628:0:15285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938587.643646:0:15285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcde919f-d270-4443-90d5-314650605a2d+28:10024:x1871643326026112:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 89us (2939us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938587.643652:0:15285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 382 00010000:00010000:1.0:1784938587.643699:0:19395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0617c lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5377 expref: 27 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.643710:0:19395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:19395:1871643342495488:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938587.643769:0:15286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.643937:0:16102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:12803:x1871643342492544:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 30895us (31371us total) trans 4294967545 rc 0/0 00000100:00100000:3.0:1784938587.643946:0:16102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 887 00000100:00100000:3.0:1784938587.643964:0:16102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 902 00000100:00100000:3.0:1784938587.643972:0:16102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:12805:x1871643342494336:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938587.643991:0:16102:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:179 count 1 00010000:00010000:3.0:1784938587.644013:0:16102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.644027:0:16102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a06263 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e7 expref: 16 pid: 19405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.644034:0:16102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb3:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1784938587.644038:0:16102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.644041:0:16102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 4/0,1 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.644093:0:16102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a06263 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e7 expref: 16 pid: 19405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.644106:0:16102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a06263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e7 expref: 16 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.644119:0:16102:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:16102:1871643342496256:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938587.644167:0:16102:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938587.644231:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938587.644301:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00080000:0.0:1784938587.644368:0:16104:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:174 count 1 00010000:00010000:0.0:1784938587.644385:0:16104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.644397:0:16104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a06183 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5393 expref: 16 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.644404:0:16104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xae:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.644408:0:16104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.644411:0:16104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.644430:0:16104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a06183 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5393 expref: 16 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.644439:0:16104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a06183 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5393 expref: 16 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.644448:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.644449:0:16104:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:16104:1871643342496384:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.644475:0:16104:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746028c6600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938587.644492:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326025344 00000100:00100000:0.0:1784938587.644499:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326025344 00010000:00010000:0.0:1784938587.644528:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a05f22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d534d expref: 17 pid: 19394 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.644547:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326025856 00000100:00100000:0.0:1784938587.644550:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326025856 00010000:00010000:0.0:1784938587.644563:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a061bb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53bd expref: 27 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.644575:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 383 00000100:00100000:0.0:1784938587.644581:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+17:10025:x1871643326025344:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.644592:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.644597:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a05f22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d534d expref: 17 pid: 19394 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.644607:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a05f22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d534d expref: 17 pid: 19394 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.644621:0:17728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a05f22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d534d expref: 17 pid: 19394 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.644632:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.644635:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.644639:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.644647:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645148:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.645177:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+16:10025:x1871643326025344:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 595us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.645185:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 383 00000100:00100000:0.0:1784938587.645203:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326025984 00000100:00100000:0.0:1784938587.645207:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326025984 00010000:00010000:0.0:1784938587.645222:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008bea93d3/0xcd9d312a94a0616e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5370 expref: 28 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.645238:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 384 00000100:00100000:0.0:1784938587.645245:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974710d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+28:10025:x1871643326025856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.645253:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.645258:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a061bb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53bd expref: 28 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645267:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a061bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53bd expref: 28 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645282:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.645285:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.645290:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645297:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.645317:0:19397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645321:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938587.645326:0:19397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.645336:0:19397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.645339:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974710d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+28:10025:x1871643326025856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 94us (1038us total) trans 0 rc 0/0 00010000:00010000:3.0:1784938587.645344:0:19397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.645345:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 384 00000100:00100000:0.0:1784938587.645359:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 385 00010000:00010000:3.0:1784938587.645360:0:19397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1784938587.645364:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+27:10025:x1871643326025984:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.645372:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.645376:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008bea93d3/0xcd9d312a94a0616e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5370 expref: 27 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645384:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008bea93d3/0xcd9d312a94a0616e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5370 expref: 27 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645395:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.645398:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.645401:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645408:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645418:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.645433:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+27:10025:x1871643326025984:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 69us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.645446:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 385 00010000:00010000:0.0:1784938587.645471:0:15288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938587.645478:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645485:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.645490:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645499:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645510:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645517:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06a7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645534:0:15288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938587.645538:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645544:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924fc00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.645547:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645564:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645574:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645580:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003086b493/0xcd9d312a94a06a9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645593:0:15288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938587.645596:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645602:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.645605:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645613:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645622:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645629:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a06aa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645651:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.645653:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.645656:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.645678:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.645706:0:19390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a061bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53bd expref: 26 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.645716:0:19390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:19390:1871643342495616:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938587.645731:0:19390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645740:0:19390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645746:0:19390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645858:0:19390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645866:0:19390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.645883:0:19390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938587.646260:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:12805:x1871643342493312:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 22376us (23049us total) trans 4294967546 rc 0/0 00000100:00100000:0.0:1784938587.646275:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 896 00010000:00010000:1.0:1784938587.646590:0:19395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.646628:0:19398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bea93d3/0xcd9d312a94a0616e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5370 expref: 25 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.646640:0:19398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19398:1871643342495744:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938587.646658:0:19398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.646673:0:19398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.646681:0:19398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.646689:0:19398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.646696:0:19398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.646718:0:19398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1784938587.647039:0:19397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+13:12803:x1871643342493440:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 30380us (33008us total) trans 4294967556 rc 0/0 00000100:00100000:3.0:1784938587.647053:0:19397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 893 00000100:00100000:1.0:1784938587.647564:0:19398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+13:12804:x1871643342492672:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 20547us (20741us total) trans 4294967547 rc 0/0 00000100:00100000:1.0:1784938587.647574:0:19398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 897 00010000:00010000:1.0:1784938587.647618:0:19399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039cbf935/0xcd9d312a94a06167 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d539a expref: 24 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.647632:0:19399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:19399:1871643342495872:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938587.647646:0:19399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.647655:0:19399:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.647670:0:19399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.647679:0:19399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.647686:0:19399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.647707:0:19399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1784938587.650493:0:19399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+13:12804:x1871643342493184:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 23450us (24038us total) trans 4294967548 rc 0/0 00000100:00100000:1.0:1784938587.650507:0:19399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 898 00010000:00010000:1.0:1784938587.650585:0:19396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a06175 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d538c expref: 15 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.650602:0:19396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:19396:1871643342496000:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938587.650626:0:19396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.650638:0:19396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.650643:0:19396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.650662:0:19396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.650670:0:19396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.650679:0:19396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1784938587.651551:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938587.651618:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.651789:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326026368 00000100:00100000:0.0:1784938587.651798:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326026368 00010000:00010000:0.0:1784938587.651843:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a061f3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53cb expref: 15 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.651897:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326025600 00000100:00100000:0.0:1784938587.651900:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326025600 00010000:00010000:0.0:1784938587.651917:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da0da745/0xcd9d312a94a06159 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5385 expref: 24 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.651935:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 386 00000100:00100000:0.0:1784938587.651944:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+15:10025:x1871643326026368:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.651963:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.651969:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a061f3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53cb expref: 15 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.651980:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a061f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53cb expref: 15 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.651987:0:16102:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:16102:1871643342496256:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938587.652007:0:16102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.652008:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.652012:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.652019:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.652028:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.652060:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.652107:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+15:10025:x1871643326026368:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 162us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.652114:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 386 00000100:00100000:0.0:1784938587.652133:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 387 00000100:00100000:0.0:1784938587.652141:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+24:10023:x1871643326025600:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.652149:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.652153:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da0da745/0xcd9d312a94a06159 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5385 expref: 24 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.652164:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da0da745/0xcd9d312a94a06159 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5385 expref: 24 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.652180:0:17728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da0da745/0xcd9d312a94a06159 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5385 expref: 24 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.652193:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.652196:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.652201:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.652208:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.652239:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.652260:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+23:10023:x1871643326025600:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 119us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.652266:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 387 00000100:00100000:0.0:1784938587.652318:0:12804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967543 gen 2 00000004:00080000:0.0:1784938587.652323:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601c21180, transno 4294967529 00000004:00080000:0.0:1784938587.652332:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601c20a80, transno 4294967530 00000004:00080000:0.0:1784938587.652335:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601c22680, transno 4294967531 00000004:00080000:0.0:1784938587.652337:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601c21500, transno 4294967532 00000004:00080000:0.0:1784938587.652340:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601c23480, transno 4294967533 00000004:00080000:0.0:1784938587.652342:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601c20380, transno 4294967534 00000004:00080000:0.0:1784938587.652345:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601c22a00, transno 4294967535 00000004:00080000:0.0:1784938587.652348:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9747358f8700, transno 4294967536 00000004:00080000:0.0:1784938587.652350:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601c23800, transno 4294967537 00000004:00080000:0.0:1784938587.652352:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e6680, transno 4294967538 00000004:00080000:0.0:1784938587.652354:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9747358f9180, transno 4294967539 00000004:00080000:0.0:1784938587.652357:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974607d60a80, transno 4294967540 00000004:00080000:0.0:1784938587.652359:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974704027100, transno 4294967541 00000004:00080000:0.0:1784938587.652361:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974704025180, transno 4294967542 00000004:00080000:0.0:1784938587.652364:0:12804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974704026680, transno 4294967543 00000100:00100000:0.0:1784938587.652371:0:12804:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff97472a1e5500 x1871643342492672/t4294967547(4294967547) o6->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:28/4 lens 544/432 e 0 to 0 dl 1784938603 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1784938587.652381:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e5500/2, rc 0, transno 4294967547 00000100:00100000:0.0:1784938587.652386:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342492672:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:0.0:1784938587.652397:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e5f80/2, rc 0, transno 4294967548 00000100:00100000:0.0:1784938587.652400:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342493184:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:0.0:1784938587.652745:0:24746:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 16 changes, 8 in progress, 6 in flight, 15 done 00000100:00100000:0.0:1784938587.652843:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342496512:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.652890:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938587.652897:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342496640:192.168.202.104@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1784938587.652926:0:15288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784938587.652932:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.652941:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.652946:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.652957:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.652969:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.652977:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b00aaf0/0xcd9d312a94a06aba lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.652995:0:15288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938587.652999:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653017:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.653021:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653028:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653037:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653044:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a06ac1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653059:0:15288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938587.653062:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653068:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.653071:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653077:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653086:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653100:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a06ac8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653113:0:15288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938587.653117:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653123:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.653126:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653134:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653144:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653151:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a06acf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653162:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.653164:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.653165:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.653176:0:19405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653195:0:19405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653204:0:19405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.653211:0:19405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.653217:0:15286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938587.653224:0:19405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938587.653243:0:15286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcde919f-d270-4443-90d5-314650605a2d+22:10024:x1871643326025728:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 11111us (12567us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938587.653250:0:15286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 380 00010000:00010000:2.0:1784938587.653296:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938587.653301:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.653318:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938587.653321:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.653328:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.653340:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.653348:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092dedbf9/0xcd9d312a94a06a82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.653363:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.653365:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.653366:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784938587.653391:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e7100/2, rc 0, transno 4294967544 00000100:00100000:2.0:1784938587.653402:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342492928:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938587.653415:0:12803:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967555 gen 2 00000004:00080000:2.0:1784938587.653418:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974717eea300, transno 4294967532 00000004:00080000:2.0:1784938587.653426:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974717ee9500, transno 4294967533 00000004:00080000:2.0:1784938587.653429:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601f3c380, transno 4294967534 00000004:00080000:2.0:1784938587.653431:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974717eebb80, transno 4294967535 00000004:00080000:2.0:1784938587.653433:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974717ee9c00, transno 4294967536 00000004:00080000:2.0:1784938587.653436:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974717ee9180, transno 4294967537 00000004:00080000:2.0:1784938587.653444:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601f3f480, transno 4294967538 00000004:00080000:2.0:1784938587.653447:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97473f605180, transno 4294967539 00000004:00080000:2.0:1784938587.653450:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97473f604e00, transno 4294967540 00000004:00080000:2.0:1784938587.653452:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601c21880, transno 4294967541 00000004:00080000:2.0:1784938587.653455:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9746047bdc00, transno 4294967542 00000004:00080000:2.0:1784938587.653457:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601f3f800, transno 4294967543 00000004:00080000:2.0:1784938587.653460:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9746047bed80, transno 4294967544 00000004:00080000:2.0:1784938587.653463:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97473f605f80, transno 4294967545 00000004:00080000:2.0:1784938587.653465:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e4a80, transno 4294967546 00000004:00080000:2.0:1784938587.653468:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e4380, transno 4294967547 00000004:00080000:2.0:1784938587.653471:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e4700, transno 4294967548 00000004:00080000:2.0:1784938587.653473:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974704025500, transno 4294967549 00000004:00080000:2.0:1784938587.653476:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974704025c00, transno 4294967550 00000004:00080000:2.0:1784938587.653478:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974609ea2300, transno 4294967551 00000004:00080000:2.0:1784938587.653481:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974704027480, transno 4294967552 00000004:00080000:2.0:1784938587.653484:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974704025880, transno 4294967553 00000004:00080000:2.0:1784938587.653486:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974704026300, transno 4294967554 00000004:00080000:2.0:1784938587.653488:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e6d80, transno 4294967555 00000100:00100000:2.0:1784938587.653494:0:12803:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff974607d61f80 x1871643342493440/t4294967556(4294967556) o6->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 544/432 e 0 to 0 dl 1784938603 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1784938587.653503:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974607d61f80/2, rc 0, transno 4294967556 00000100:00100000:2.0:1784938587.653507:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342493440:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:2.0:1784938587.653521:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e6a00/2, rc 0, transno 4294967545 00000100:00100000:2.0:1784938587.653525:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342492544:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.653601:0:19405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+13:12803:x1871643342493056:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 40114us (40962us total) trans 4294967549 rc 0/0 00000100:00100000:0.0:1784938587.653609:0:19405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 888 00000100:00100000:0.0:1784938587.653640:0:16104:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:16104:1871643342496384:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938587.653653:0:16104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.653702:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342496768:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.653732:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938587.653738:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342496896:192.168.202.104@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1784938587.653783:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938587.653974:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938587.654078:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938587.654111:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938587.654140:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938587.654158:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342496896 00000100:00100000:0.0:1784938587.654164:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342496896 00000100:00100000:0.0:1784938587.654193:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342496512 00000100:00100000:0.0:1784938587.654196:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342496512 00000100:00100000:0.0:1784938587.654211:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342496640 00000100:00100000:0.0:1784938587.654213:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342496640 00000100:00100000:0.0:1784938587.654227:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342496768 00000100:00100000:0.0:1784938587.654229:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342496768 00000100:00100000:0.0:1784938587.654248:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 903 00000100:00100000:0.0:1784938587.654255:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:12804:x1871643342496896:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:2.0:1784938587.654261:0:24744:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 6 changes, 8 in progress, 7 in flight, 24 done 00002000:00080000:0.0:1784938587.654279:0:19390:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:195 count 1 00010000:00010000:0.0:1784938587.654301:0:19390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938587.654306:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e4e00/2, rc 0, transno 4294967549 00000100:00100000:2.0:1784938587.654313:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342493056:192.168.202.104@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1784938587.654318:0:19390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000773348ce/0xcd9d312a94a061e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d2 expref: 21 pid: 17487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938587.654326:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1784938587.654327:0:19390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.654331:0:19390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1784938587.654334:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342497024:192.168.202.104@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1784938587.654336:0:19390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.654362:0:19390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000773348ce/0xcd9d312a94a061e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d2 expref: 21 pid: 17487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.654375:0:19390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000773348ce/0xcd9d312a94a061e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d2 expref: 21 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938587.654385:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e6300/2, rc 0, transno 4294967546 00000100:00100000:2.0:1784938587.654389:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342493312:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.654393:0:19390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:19390:1871643342497152:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.654428:0:19390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746028c6600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938587.654479:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342497280:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.654515:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342497408:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.654548:0:19405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 904 00000100:00100000:0.0:1784938587.654556:0:19405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+16:12802:x1871643342496512:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938587.654569:0:19405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:196 count 1 00010000:00010000:0.0:1784938587.654581:0:19405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.654592:0:19405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a061ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a8 expref: 21 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.654598:0:19405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.654601:0:19405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.654605:0:19405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.654623:0:19405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a061ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a8 expref: 21 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.654633:0:19405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a061ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a8 expref: 21 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.654656:0:19405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:19405:1871643342497536:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.654681:0:19405:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746028c6780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938587.655134:0:19397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 905 00000100:00100000:3.0:1784938587.655145:0:19397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+16:12802:x1871643342496640:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:3.0:1784938587.655164:0:19397:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:168 count 1 00010000:00010000:3.0:1784938587.655177:0:19397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.655202:0:19397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6087e00/0xcd9d312a94a061a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a1 expref: 21 pid: 16105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.655209:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1784938587.655212:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.655216:0:19397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.655237:0:19397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6087e00/0xcd9d312a94a061a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a1 expref: 21 pid: 16105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.655260:0:19397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6087e00/0xcd9d312a94a061a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a1 expref: 21 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.655270:0:19397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:19397:1871643342497664:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938587.655304:0:19397:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938587.656025:0:19396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:12804:x1871643342493696:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 28035us (29553us total) trans 4294967557 rc 0/0 00010000:00010000:3.0:1784938587.656031:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938587.656034:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 899 00000100:00100000:1.0:1784938587.656062:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 906 00010000:00010000:3.0:1784938587.656064:0:19388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a061f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53cb expref: 14 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.656071:0:19396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:12804:x1871643342496768:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938587.656079:0:19388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19388:1871643342496128:192.168.202.4@tcp:104: 00002000:00080000:1.0:1784938587.656088:0:19396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:193 count 1 00010000:00010000:3.0:1784938587.656098:0:19388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656101:0:19396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.656109:0:19388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656113:0:19396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a061b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53b6 expref: 21 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.656116:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656121:0:19396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=10s v=(0 0) 00010000:00010000:1.0:1784938587.656125:0:19396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.656128:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656129:0:19396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.656138:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656164:0:19396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a061b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53b6 expref: 21 pid: 19393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.656167:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938587.656175:0:19396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a061b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53b6 expref: 21 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.656187:0:19396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:19396:1871643342497792:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938587.656227:0:19396:0:(client.c:2702:ptlrpc_set_wait()) set ffff974713587d80 going to sleep for 11 seconds 00010000:00010000:1.0:1784938587.656243:0:19395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656252:0:19395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656260:0:19395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656267:0:19395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656282:0:19395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1784938587.656634:0:19395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:12805:x1871643342492800:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 33069us (33532us total) trans 4294967550 rc 0/0 00000100:00100000:1.0:1784938587.656641:0:19395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 895 00010000:00010000:1.0:1784938587.656690:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938587.656696:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656704:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938587.656708:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656717:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656737:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656744:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a06ad6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656794:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938587.656798:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656805:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938587.656808:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656815:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656849:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656857:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a06ab3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.656871:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938587.656873:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938587.656874:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938587.656881:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.657302:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938587.658096:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:12804:x1871643342494208:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 29734us (31418us total) trans 4294967558 rc 0/0 00000100:00100000:3.0:1784938587.658106:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 900 00010000:00010000:3.0:1784938587.658143:0:16105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.658153:0:16105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.658163:0:16105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.658170:0:16105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784938587.658637:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938587.658642:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784938587.661415:0:16105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938587.661976:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938587.662030:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938587.662110:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1784938587.662135:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938587.662145:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.662156:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1784938587.662158:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924ec00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938587.662164:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.662176:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.662203:0:15286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326026496 00000100:00100000:1.0:1784938587.662212:0:15286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326026496 00010000:00010000:1.0:1784938587.662247:0:15286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a06263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e7 expref: 14 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.662275:0:15286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326026624 00000100:00100000:1.0:1784938587.662278:0:15286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326026624 00010000:00010000:1.0:1784938587.662291:0:15286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a06183 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5393 expref: 15 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.662303:0:15286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326024960 00000100:00100000:1.0:1784938587.662311:0:15286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326024960 00010000:00010000:1.0:1784938587.662327:0:15286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e01f7a01/0xcd9d312a94a05ece lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5354 expref: 22 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.662338:0:15286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326025472 00000100:00100000:1.0:1784938587.662340:0:15286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326025472 00010000:00010000:1.0:1784938587.662350:0:15286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a061ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53af expref: 16 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.662365:0:15286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 388 00000100:00100000:1.0:1784938587.662372:0:15286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcde919f-d270-4443-90d5-314650605a2d+16:10025:x1871643326026496:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938587.662385:0:15286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938587.662390:0:15286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a06263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e7 expref: 16 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662402:0:15286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a06263 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e7 expref: 16 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662424:0:15286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a06263 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e7 expref: 16 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662441:0:15286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.662445:0:15286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.662450:0:15286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662461:0:15286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662492:0:15286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938587.662532:0:15286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcde919f-d270-4443-90d5-314650605a2d+15:10025:x1871643326026496:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 160us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938587.662540:0:15286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 388 00000100:00100000:1.0:1784938587.662556:0:15286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 389 00000100:00100000:1.0:1784938587.662562:0:15286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcde919f-d270-4443-90d5-314650605a2d+14:10024:x1871643326026624:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938587.662570:0:15286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938587.662575:0:15286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a06183 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5393 expref: 14 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662583:0:15286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a06183 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5393 expref: 14 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662594:0:15286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a06183 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5393 expref: 14 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662603:0:15286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.662606:0:15286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.662610:0:15286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662617:0:15286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662643:0:15286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938587.662661:0:15286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcde919f-d270-4443-90d5-314650605a2d+13:10024:x1871643326026624:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 99us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938587.662667:0:15286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 389 00000100:00100000:1.0:1784938587.662679:0:15286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 390 00000100:00100000:1.0:1784938587.662684:0:15286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcde919f-d270-4443-90d5-314650605a2d+22:10026:x1871643326024960:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938587.662691:0:15286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938587.662696:0:15286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e01f7a01/0xcd9d312a94a05ece lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5354 expref: 22 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662707:0:15286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e01f7a01/0xcd9d312a94a05ece lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5354 expref: 22 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662720:0:15286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e01f7a01/0xcd9d312a94a05ece lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5354 expref: 22 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662729:0:15286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.662732:0:15286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.662737:0:15286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662744:0:15286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662794:0:15286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938587.662814:0:15286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcde919f-d270-4443-90d5-314650605a2d+21:10026:x1871643326024960:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 129us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938587.662820:0:15286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 390 00000100:00100000:1.0:1784938587.662846:0:15286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 391 00000100:00100000:1.0:1784938587.662852:0:15286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974710d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcde919f-d270-4443-90d5-314650605a2d+12:10026:x1871643326025472:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938587.662861:0:15286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938587.662865:0:15286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a061ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53af expref: 12 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662875:0:15286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a061ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53af expref: 12 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662888:0:15286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a061ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53af expref: 12 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662897:0:15286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.662900:0:15286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.662904:0:15286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662911:0:15286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.662940:0:15286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938587.662961:0:15286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974710d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcde919f-d270-4443-90d5-314650605a2d+11:10026:x1871643326025472:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 108us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938587.662967:0:15286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 391 00010000:00010000:1.0:1784938587.663018:0:19394:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.663027:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.663037:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.663044:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.663060:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938587.663283:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.663291:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d892b605/0xcd9d312a94a06a90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.663311:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938587.663315:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.663333:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938587.663336:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.663344:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.663354:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.663361:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008149d7f/0xcd9d312a94a06a97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.663374:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.663376:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.663378:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938587.663396:0:19394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601de4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:12803:x1871643342492416:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 48823us (50695us total) trans 4294967551 rc 0/0 00000100:00100000:1.0:1784938587.663405:0:19394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 891 00010000:00010000:1.0:1784938587.663430:0:19389:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.663439:0:19389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.663457:0:19389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.663465:0:19389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.663479:0:19389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938587.666012:0:16102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.666030:0:16102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.666042:0:16102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.666060:0:16102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.666075:0:16102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1784938587.669033:0:19397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:19397:1871643342497664:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938587.669074:0:19397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.669103:0:19392:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.669112:0:19392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.669125:0:19392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.669134:0:19392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.669152:0:19392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:3.0:1784938587.669478:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472ff20a80/2, rc 0, transno 4294967557 00000100:00100000:3.0:1784938587.669490:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472ff20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342493696:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938587.669502:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472ff21880/2, rc 0, transno 4294967558 00000100:00100000:3.0:1784938587.669515:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472ff21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342494208:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938587.669549:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e7b80/2, rc 0, transno 4294967550 00000100:00100000:3.0:1784938587.669560:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342492800:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.672074:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938587.672099:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342497920:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.672211:0:19405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:19405:1871643342497536:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938587.672236:0:19405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.672271:0:19390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:19390:1871643342497152:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938587.672283:0:19390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.673002:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00010000:00010000:2.0:1784938587.673069:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784938587.673078:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.673088:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924e400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938587.673092:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.673102:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.673112:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00010000:00010000:2.0:1784938587.673131:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.673132:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00010000:00010000:2.0:1784938587.673139:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eeb96af/0xcd9d312a94a06aac lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.673147:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00010000:00010000:2.0:1784938587.673160:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938587.673164:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.673171:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938587.673175:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.673194:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938587.673195:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e5880/2, rc 0, transno 4294967551 00000100:00100000:0.0:1784938587.673205:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342492416:192.168.202.104@tcp:6:osp-syn-1-0.0 00010000:00010000:2.0:1784938587.673206:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.673213:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a06add lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.673226:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938587.673230:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.673241:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938587.673245:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.673252:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.673255:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342498048:192.168.202.104@tcp:6:osp-syn-1-0.0 00010000:00010000:2.0:1784938587.673263:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.673270:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a06a89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.673282:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.673284:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.673286:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.673292:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938587.673347:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342498176:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938587.673386:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342498304:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938587.673500:0:19396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:19396:1871643342497792:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938587.673518:0:19396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.673544:0:19395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342497024 00000100:00100000:1.0:1784938587.673549:0:19395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342497024 00000100:00100000:1.0:1784938587.673590:0:19395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342497280 00000100:00100000:1.0:1784938587.673594:0:19395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342497280 00000100:00100000:1.0:1784938587.673612:0:19395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342497920 00000100:00100000:1.0:1784938587.673614:0:19395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342497920 00000100:00100000:1.0:1784938587.673627:0:19395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342497408 00000100:00100000:1.0:1784938587.673630:0:19395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342497408 00000100:00100000:1.0:1784938587.673646:0:19395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 907 00000100:00100000:1.0:1784938587.673654:0:19395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:12803:x1871643342497024:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938587.673677:0:19393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 908 00000100:00100000:1.0:1784938587.673683:0:19393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:12803:x1871643342497280:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938587.673708:0:19393:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:187 count 1 00010000:00010000:1.0:1784938587.673730:0:19393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.673770:0:19393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a061fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d9 expref: 20 pid: 19405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.673779:0:19393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbb:0x0].0x0 since=10s v=(0 0) 00010000:00010000:1.0:1784938587.673783:0:19393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.673788:0:19393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.673816:0:19393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a061fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d9 expref: 20 pid: 19405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.673839:0:19393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a061fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d9 expref: 20 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.673851:0:19393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:19393:1871643342498432:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938587.677138:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938587.677835:0:19398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342498048 00000100:00100000:0.0:1784938587.677916:0:19398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342498048 00000100:00100000:0.0:1784938587.677974:0:19398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 909 00000100:00100000:0.0:1784938587.677983:0:19398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+20:12804:x1871643342497920:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938587.678016:0:19398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:166 count 1 00010000:00010000:0.0:1784938587.678042:0:19398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.678064:0:19398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a06224 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53ee expref: 20 pid: 16104 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.678073:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.678077:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.678082:0:19398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.678120:0:19398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a06224 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53ee expref: 20 pid: 16104 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.678133:0:19398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a06224 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53ee expref: 20 pid: 16104 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.678149:0:19398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19398:1871643342498560:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.678208:0:19398:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746028c6600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938587.678229:0:17487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 910 00000100:00100000:0.0:1784938587.678237:0:17487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:12804:x1871643342497408:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938587.678268:0:17487:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:170 count 1 00010000:00010000:0.0:1784938587.678280:0:17487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.678292:0:17487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a0621d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e0 expref: 20 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.678299:0:17487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.678303:0:17487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.678306:0:17487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.678325:0:17487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a0621d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e0 expref: 20 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.678334:0:17487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a0621d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e0 expref: 20 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.678344:0:17487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17487:1871643342498688:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.678366:0:17487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746028c6780 going to sleep for 11 seconds 00010000:00010000:0.0:1784938587.678378:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.678390:0:16104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.678398:0:16104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.678419:0:16104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.678426:0:16104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.678448:0:16104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938587.680520:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00010000:00010000:0.0:1784938587.680736:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938587.680746:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.683409:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148aa00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.683417:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.683431:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.683453:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.683461:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bac2f56/0xcd9d312a94a06ae4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.683499:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.683517:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.683520:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.683528:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938587.683591:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938587.683736:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:12803:x1871643342493952:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 67422us (70934us total) trans 4294967559 rc 0/0 00000100:00100000:0.0:1784938587.683746:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 894 00000100:00100000:0.0:1784938587.683793:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342498176 00000100:00100000:0.0:1784938587.683801:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342498176 00000100:00100000:0.0:1784938587.683839:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342498304 00000100:00100000:0.0:1784938587.683842:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342498304 00000100:00100000:0.0:1784938587.683872:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 911 00000100:00100000:0.0:1784938587.683881:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:12802:x1871643342498048:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938587.683930:0:19389:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:197 count 1 00010000:00010000:0.0:1784938587.683959:0:19389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.683977:0:19389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004dff866e/0xcd9d312a94a0622b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53f5 expref: 20 pid: 19396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.683986:0:19389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.683991:0:19389:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.683996:0:19389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.684005:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1784938587.684036:0:19389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004dff866e/0xcd9d312a94a0622b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53f5 expref: 20 pid: 19396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.684066:0:19389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004dff866e/0xcd9d312a94a0622b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53f5 expref: 20 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.684084:0:19389:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:19389:1871643342498816:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938587.684144:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.684147:0:19389:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746028c6e40 going to sleep for 11 seconds 00000004:00080000:0.0:1784938587.684221:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472ff20e00/2, rc 0, transno 4294967559 00000100:00100000:3.0:1784938587.684224:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.684235:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472ff20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342493952:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938587.684244:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938587.684290:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938587.684309:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326026752 00000100:00100000:3.0:1784938587.684312:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326026752 00000100:00100000:0.0:1784938587.684313:0:19398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19398:1871643342498560:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938587.684330:0:19398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684334:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000773348ce/0xcd9d312a94a061e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d2 expref: 21 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.684349:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326027136 00000100:00100000:3.0:1784938587.684352:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326027136 00000100:00100000:0.0:1784938587.684354:0:17487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17487:1871643342498688:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938587.684362:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a061b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53b6 expref: 22 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.684365:0:17487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.684374:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326026880 00000100:00100000:3.0:1784938587.684376:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326026880 00000100:00100000:0.0:1784938587.684382:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1784938587.684386:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a061ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a8 expref: 23 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.684391:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342498944:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938587.684397:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326027008 00000100:00100000:3.0:1784938587.684399:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326027008 00010000:00010000:3.0:1784938587.684409:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6087e00/0xcd9d312a94a061a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a1 expref: 24 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.684434:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326027264 00000100:00100000:3.0:1784938587.684437:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326027264 00010000:00010000:3.0:1784938587.684450:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a06224 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53ee expref: 25 pid: 16104 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.684463:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 392 00000100:00100000:3.0:1784938587.684470:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+25:10024:x1871643326026752:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938587.684482:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784938587.684483:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00010000:00010000:3.0:1784938587.684486:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000773348ce/0xcd9d312a94a061e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d2 expref: 25 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684498:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000773348ce/0xcd9d312a94a061e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d2 expref: 25 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684515:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000773348ce/0xcd9d312a94a061e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d2 expref: 25 pid: 17487 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684527:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.684530:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.684535:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684543:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684580:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938587.684604:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+24:10024:x1871643326026752:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 134us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938587.684611:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 392 00000100:00100000:3.0:1784938587.684632:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 393 00000100:00100000:3.0:1784938587.684638:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+23:10024:x1871643326027136:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938587.684646:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938587.684650:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a061b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53b6 expref: 23 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684659:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a061b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53b6 expref: 23 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684672:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a061b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53b6 expref: 23 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684681:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.684684:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.684687:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684695:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684725:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938587.684744:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+22:10024:x1871643326027136:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 107us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938587.684775:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 393 00000100:00100000:3.0:1784938587.684789:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 394 00000100:00100000:3.0:1784938587.684795:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+21:10025:x1871643326026880:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938587.684804:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938587.684809:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a061ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a8 expref: 21 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684818:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a061ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a8 expref: 21 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684842:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a061ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a8 expref: 21 pid: 19393 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684853:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.684856:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.684859:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684866:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684894:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938587.684916:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+20:10025:x1871643326026880:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 120us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938587.684922:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 394 00000100:00100000:3.0:1784938587.684936:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 395 00000100:00100000:3.0:1784938587.684942:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+19:10025:x1871643326027008:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938587.684951:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938587.684956:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6087e00/0xcd9d312a94a061a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a1 expref: 19 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684965:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6087e00/0xcd9d312a94a061a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a1 expref: 19 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684977:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6087e00/0xcd9d312a94a061a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53a1 expref: 19 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.684986:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.684990:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.684994:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.685001:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.685030:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938587.685050:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+18:10025:x1871643326027008:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 108us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938587.685056:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 395 00000100:00100000:3.0:1784938587.685071:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 396 00000100:00100000:3.0:1784938587.685078:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+17:10024:x1871643326027264:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938587.685085:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938587.685089:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a06224 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53ee expref: 17 pid: 16104 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.685098:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a06224 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53ee expref: 17 pid: 16104 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.685110:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a06224 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53ee expref: 17 pid: 16104 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.685121:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.685123:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.685127:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.685134:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.685162:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938587.685181:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+16:10024:x1871643326027264:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 104us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938587.685187:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 396 00010000:00010000:3.0:1784938587.685212:0:19397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.685221:0:19397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.685229:0:19397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.685236:0:19397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.685249:0:19397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938587.685835:0:19397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:12802:x1871643342496640:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 30680us (31711us total) trans 4294967552 rc 0/0 00000100:00100000:3.0:1784938587.685844:0:19397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 905 00000100:00100000:3.0:1784938587.685865:0:19397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342498944 00000100:00100000:3.0:1784938587.685871:0:19397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342498944 00000100:00100000:3.0:1784938587.685894:0:19397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 912 00000100:00100000:3.0:1784938587.685901:0:19397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+17:12803:x1871643342498176:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1784938587.686631:0:19390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.686644:0:19390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.686667:0:19390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.686674:0:19390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.686692:0:19390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1784938587.687134:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:12804:x1871643342496896:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 32875us (33157us total) trans 4294967553 rc 0/0 00000100:00100000:0.0:1784938587.687143:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 903 00000100:00100000:0.0:1784938587.687171:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 913 00000100:00100000:0.0:1784938587.687180:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:12804:x1871643342498304:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1784938587.687200:0:19405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.687209:0:19405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.687217:0:19405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.687225:0:19405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.687255:0:19405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784938587.687959:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784938587.687969:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.687978:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938587.687983:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688002:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688020:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688027:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000718078d0/0xcd9d312a94a06af9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688050:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938587.688054:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688061:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148bc00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938587.688064:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688070:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688079:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688086:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034c3ba69/0xcd9d312a94a06aeb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688113:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938587.688117:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688124:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938587.688128:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688136:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688146:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688154:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a06af2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.688169:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.688170:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.688172:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938587.691944:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.692400:0:19405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+21:12802:x1871643342496512:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 37842us (38319us total) trans 4294967554 rc 0/0 00000100:00100000:0.0:1784938587.692414:0:19405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 904 00000100:00100000:0.0:1784938587.692445:0:19405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 914 00000100:00100000:0.0:1784938587.692457:0:19405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473bab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+17:12804:x1871643342498944:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1784938587.692605:0:19398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.692621:0:19398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.692635:0:19398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.692642:0:19398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.692659:0:19398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938587.693028:0:19398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+21:12804:x1871643342497920:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 15045us (19893us total) trans 4294967555 rc 0/0 00000100:00100000:0.0:1784938587.693036:0:19398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 909 00000004:00080000:0.0:1784938587.693095:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97473a637b80/2, rc 0, transno 4294967552 00000100:00100000:0.0:1784938587.693107:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342496640:192.168.202.104@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1784938587.693135:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938587.693141:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.693149:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148ba00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.693153:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.693163:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.693180:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.693188:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009733c361/0xcd9d312a94a06b0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.693208:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.693210:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.693211:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.693282:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784938587.693304:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97473a635500/2, rc 0, transno 4294967553 00000100:00100000:0.0:1784938587.693310:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342496896:192.168.202.104@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1784938587.693321:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938587.693393:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342499072:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.693441:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938587.693454:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342499200:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938587.693533:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326027392 00000100:00100000:3.0:1784938587.693540:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326027392 00010000:00010000:3.0:1784938587.693567:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a0621d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e0 expref: 16 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.693594:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 397 00000100:00100000:3.0:1784938587.693601:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+16:10025:x1871643326027392:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938587.693611:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938587.693617:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a0621d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e0 expref: 16 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.693628:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a0621d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e0 expref: 16 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.693646:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a0621d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53e0 expref: 16 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.693659:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.693663:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.693671:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.693679:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.693702:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938587.693734:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+15:10025:x1871643326027392:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 133us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938587.693741:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 397 00000100:00100000:1.0:1784938587.694454:0:19393:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460272cf00 going to sleep for 11 seconds 00010000:00010000:1.0:1784938587.694683:0:17487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.694695:0:17487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.694705:0:17487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.694725:0:17487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.694743:0:17487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938587.695589:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.695643:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326027520 00000100:00100000:0.0:1784938587.695652:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326027520 00010000:00010000:0.0:1784938587.695686:0:17728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004dff866e/0xcd9d312a94a0622b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53f5 expref: 15 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.695717:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 398 00000100:00100000:0.0:1784938587.695726:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974710d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+15:10025:x1871643326027520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.695738:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.695742:0:17728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004dff866e/0xcd9d312a94a0622b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53f5 expref: 15 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.695774:0:17728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004dff866e/0xcd9d312a94a0622b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53f5 expref: 15 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.695780:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00010000:00010000:0.0:1784938587.695799:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.695804:0:17728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.695810:0:17728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.695818:0:17728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.695847:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.695876:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974710d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcde919f-d270-4443-90d5-314650605a2d+15:10025:x1871643326027520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 151us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.695899:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 398 00000100:00100000:1.0:1784938587.696250:0:17487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:12804:x1871643342497408:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 18013us (23099us total) trans 4294967556 rc 0/0 00000100:00100000:1.0:1784938587.696259:0:17487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 910 00000100:00100000:1.0:1784938587.696279:0:17487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342499072 00000100:00100000:1.0:1784938587.696283:0:17487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342499072 00000100:00100000:1.0:1784938587.696310:0:17487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 915 00000100:00100000:1.0:1784938587.696316:0:17487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:12802:x1871643342499072:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938587.696338:0:17487:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:183 count 1 00010000:00010000:1.0:1784938587.696357:0:17487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.696371:0:17487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a06232 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53fc expref: 15 pid: 19396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.696378:0:17487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb7:0x0].0x0 since=10s v=(0 0) 00010000:00010000:1.0:1784938587.696381:0:17487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.696386:0:17487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.696414:0:17487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a06232 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53fc expref: 15 pid: 19396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.696439:0:17487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a06232 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53fc expref: 15 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.696453:0:17487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17487:1871643342499328:192.168.202.4@tcp:104: 00000004:00080000:0.0:1784938587.696705:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97473a634700/2, rc 0, transno 4294967556 00000100:00100000:0.0:1784938587.696719:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342497408:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.696796:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342499456:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938587.697323:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938587.697928:0:19394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342499456 00000100:00100000:3.0:1784938587.697936:0:19394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342499456 00000100:00100000:3.0:1784938587.697976:0:19394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 916 00000100:00100000:3.0:1784938587.697986:0:19394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:12804:x1871643342499456:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:3.0:1784938587.698008:0:19394:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:162 count 1 00010000:00010000:3.0:1784938587.698028:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.698046:0:19394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a0625c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d540a expref: 14 pid: 19405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.698054:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1784938587.698058:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.698263:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.698296:0:19394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a0625c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d540a expref: 14 pid: 19405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.698308:0:19394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a0625c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d540a expref: 14 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.698337:0:19394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:19394:1871643342499584:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938587.698394:0:19394:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938587.699407:0:17487:0:(client.c:2702:ptlrpc_set_wait()) set ffff974713587d80 going to sleep for 11 seconds 00010000:00010000:1.0:1784938587.699421:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938587.699428:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.699437:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148b600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938587.699442:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.699453:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.699488:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.699495:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060688b63/0xcd9d312a94a06b15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.699518:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938587.699520:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938587.699530:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938587.699625:0:19396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.699635:0:19396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.699645:0:19396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.699653:0:19396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.699674:0:19396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938587.700199:0:19396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:12804:x1871643342496768:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 44125us (46053us total) trans 4294967557 rc 0/0 00000100:00100000:1.0:1784938587.700208:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 906 00010000:00010000:1.0:1784938587.700372:0:19389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dff866e/0xcd9d312a94a0622b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53f5 expref: 14 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.700385:0:19389:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:19389:1871643342498816:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938587.700403:0:19389:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.700411:0:19389:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.700431:0:19389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.700439:0:19389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.700446:0:19389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.700458:0:19389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1784938587.700701:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:12802:x1871643342498048:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 16819us (23572us total) trans 4294967558 rc 0/0 00000100:00100000:1.0:1784938587.700707:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 911 00010000:00010000:0.0:1784938587.701477:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938587.701487:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.701497:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.701501:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.701510:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.701531:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.701537:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a06b00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.701557:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938587.701560:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.701580:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148b200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.701584:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.701592:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.701603:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.701610:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032105b5d/0xcd9d312a94a06b1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.701624:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.701626:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.701628:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784938587.701664:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97473a636680/2, rc 0, transno 4294967557 00000100:00100000:0.0:1784938587.701687:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342496768:192.168.202.104@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1784938587.701704:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784938587.701718:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97473a635180/2, rc 0, transno 4294967558 00000100:00100000:0.0:1784938587.701723:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342498048:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.703099:0:16105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601de5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:12803:x1871643342494080:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 88714us (90409us total) trans 4294967560 rc 0/0 00000100:00100000:0.0:1784938587.703110:0:16105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 890 00002000:00080000:0.0:1784938587.703178:0:19395:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:198 count 1 00010000:00010000:0.0:1784938587.703203:0:19395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703223:0:19395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046a76218/0xcd9d312a94a06278 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d541f expref: 10 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703231:0:19395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.703235:0:19395:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.703239:0:19395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703276:0:19395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046a76218/0xcd9d312a94a06278 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d541f expref: 10 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703289:0:19395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046a76218/0xcd9d312a94a06278 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d541f expref: 10 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.703304:0:19395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:19395:1871643342499712:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.703369:0:19395:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746028c6300 going to sleep for 11 seconds 00002000:00080000:0.0:1784938587.703404:0:19397:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:183 count 1 00010000:00010000:0.0:1784938587.703417:0:19397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703429:0:19397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a06286 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5426 expref: 10 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703449:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb7:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.703452:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.703455:0:19397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703627:0:19397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a06286 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5426 expref: 10 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703637:0:19397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a06286 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5426 expref: 10 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.703649:0:19397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:19397:1871643342499840:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.703674:0:19397:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746028c6240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938587.703733:0:19392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:12803:x1871643342493568:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 90080us (91071us total) trans 4294967563 rc 0/0 00000100:00100000:3.0:1784938587.703742:0:19392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 889 00002000:00080000:0.0:1784938587.703804:0:19390:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:175 count 1 00010000:00010000:0.0:1784938587.703818:0:19390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703839:0:19390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccbc2647/0xcd9d312a94a0627f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d542d expref: 10 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703846:0:19390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaf:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.703849:0:19390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.703853:0:19390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 4/0,1 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703882:0:19390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ccbc2647/0xcd9d312a94a0627f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d542d expref: 10 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703891:0:19390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ccbc2647/0xcd9d312a94a0627f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d542d expref: 10 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.703901:0:19390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:19390:1871643342499968:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.703923:0:19390:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746028c6e40 going to sleep for 11 seconds 00002000:00080000:0.0:1784938587.703956:0:19405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:162 count 1 00010000:00010000:0.0:1784938587.703967:0:19405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703977:0:19405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0628d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5434 expref: 10 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.703983:0:19405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.703986:0:19405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.703989:0:19405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.704020:0:19405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0628d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5434 expref: 10 pid: 19395 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.704029:0:19405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0628d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5434 expref: 10 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.704043:0:19405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19405:1871643342500096:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.704065:0:19405:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746028c6600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938587.704346:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000004:00080000:0.0:1784938587.706859:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97473a634a80/2, rc 0, transno 4294967554 00000100:00100000:0.0:1784938587.706877:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342496512:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:0.0:1784938587.706910:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97473a634380/2, rc 0, transno 4294967555 00000100:00100000:0.0:1784938587.706915:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342497920:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.706942:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342499200 00000100:00100000:0.0:1784938587.706949:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342499200 00000100:00100000:0.0:1784938587.707026:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 917 00000100:00100000:0.0:1784938587.707036:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974717eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:12802:x1871643342499200:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938587.707067:0:19388:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:200 count 1 00010000:00010000:0.0:1784938587.707093:0:19388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.707114:0:19388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a06239 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5403 expref: 13 pid: 19396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.707123:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.707126:0:19388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.707131:0:19388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.707164:0:19388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a06239 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5403 expref: 13 pid: 19396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.707193:0:19388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a06239 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5403 expref: 13 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.707208:0:19388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19388:1871643342500224:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.707282:0:19388:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746028c6780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938587.707309:0:19394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:19394:1871643342499584:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938587.707329:0:19394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.708397:0:19393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:19393:1871643342498432:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938587.708420:0:19393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.708676:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342500480:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.708774:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938587.708782:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342500608:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.708819:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342500352:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938587.708836:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342500736:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938587.709075:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938587.709095:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938587.709109:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938587.709145:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000004:00080000:3.0:1784938587.709540:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974607d60700/2, rc 0, transno 4294967563 00000100:00100000:3.0:1784938587.709564:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342493568:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938587.709576:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472ff21c00/2, rc 0, transno 4294967560 00000100:00100000:3.0:1784938587.709580:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472ff21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342494080:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938587.709815:0:16102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:12805:x1871643342494336:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 65842us (81484us total) trans 4294967561 rc 0/0 00000100:00100000:3.0:1784938587.709835:0:16102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 902 00000100:00100000:3.0:1784938587.709861:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342500480 00000100:00100000:3.0:1784938587.709868:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342500480 00000100:00100000:3.0:1784938587.709900:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342500608 00000100:00100000:3.0:1784938587.709902:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342500608 00000100:00100000:2.0:1784938587.710157:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938587.710169:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342500992:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938587.710224:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342500352 00000100:00100000:2.0:1784938587.710227:0:19398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342500736 00000100:00100000:3.0:1784938587.710228:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342500352 00000100:00100000:2.0:1784938587.710231:0:19398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342500736 00000100:00100000:3.0:1784938587.710246:0:16102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 918 00000100:00100000:3.0:1784938587.710319:0:16102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974717ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:12802:x1871643342500480:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:3.0:1784938587.710348:0:16102:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:190 count 1 00010000:00010000:3.0:1784938587.710372:0:16102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.710407:0:16102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a06271 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5418 expref: 13 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.710416:0:16102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbe:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1784938587.710421:0:16102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.710426:0:16102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.710453:0:16102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a06271 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5418 expref: 13 pid: 19398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.710466:0:16102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a06271 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5418 expref: 13 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.710479:0:16102:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc89c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:16102:1871643342501120:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938587.710525:0:16102:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938587.717560:0:19398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 919 00000100:00100000:2.0:1784938587.717586:0:19398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974717eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+27:12802:x1871643342500608:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938587.717624:0:19398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:199 count 1 00010000:00010000:2.0:1784938587.717653:0:19398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.717674:0:19398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a062be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5442 expref: 13 pid: 16105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.717683:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=10s v=(0 0) 00010000:00010000:2.0:1784938587.717688:0:19398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938587.717693:0:19398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.717733:0:19398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a062be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5442 expref: 13 pid: 16105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.717747:0:19398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a062be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5442 expref: 13 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.717878:0:16105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 920 00000100:00100000:0.0:1784938587.717890:0:16105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974717ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:12805:x1871643342500352:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938587.718036:0:16105:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:175 count 1 00010000:00010000:0.0:1784938587.718053:0:16105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.718066:0:16105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a0626a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5411 expref: 13 pid: 16105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.718094:0:16105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.718097:0:16105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.718101:0:16105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.718125:0:16105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a0626a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5411 expref: 13 pid: 16105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.718135:0:16105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a0626a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5411 expref: 13 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.718152:0:16105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:16105:1871643342501376:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.718240:0:16105:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460272cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938587.718364:0:16104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:12805:x1871643342493824:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 75565us (90102us total) trans 4294967562 rc 0/0 00000100:00100000:0.0:1784938587.718373:0:16104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 901 00000100:00100000:0.0:1784938587.718402:0:16104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 921 00000100:00100000:0.0:1784938587.718410:0:16104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974717ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:12804:x1871643342500736:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1784938587.718425:0:16104:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:171 count 1 00010000:00010000:0.0:1784938587.718438:0:16104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.718448:0:16104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a06294 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5450 expref: 13 pid: 19405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.718465:0:16104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1784938587.718468:0:16104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.718471:0:16104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.718489:0:16104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a06294 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5450 expref: 13 pid: 19405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.718499:0:16104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a06294 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5450 expref: 13 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.718509:0:16104:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:16104:1871643342501504:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.718533:0:16104:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460272c900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938587.718687:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.719359:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.719441:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.719463:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938587.719475:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938587.719515:0:19398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19398:1871643342501248:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938587.719517:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.719531:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938587.719546:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938587.719566:0:19398:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460935f300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938587.719588:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938587.719589:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938587.719604:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342500864:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938587.719620:0:19395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:19395:1871643342499712:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938587.719640:0:19395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.719676:0:19390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:19390:1871643342499968:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938587.719689:0:19390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938587.719697:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938587.719711:0:19405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19405:1871643342500096:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938587.719723:0:19405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.719743:0:19388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19388:1871643342500224:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938587.719781:0:19388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.719801:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326027648 00000100:00100000:0.0:1784938587.719806:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326027648 00010000:00010000:0.0:1784938587.719845:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a0625c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d540a expref: 14 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.719868:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326027776 00000100:00100000:0.0:1784938587.719871:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326027776 00010000:00010000:0.0:1784938587.719883:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a06232 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53fc expref: 15 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.719895:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326028032 00000100:00100000:0.0:1784938587.719898:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326028032 00010000:00010000:0.0:1784938587.720072:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a06286 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5426 expref: 11 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.720088:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326027904 00000100:00100000:0.0:1784938587.720091:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326027904 00010000:00010000:0.0:1784938587.720103:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046a76218/0xcd9d312a94a06278 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d541f expref: 12 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.720114:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326028160 00000100:00100000:0.0:1784938587.720116:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326028160 00010000:00010000:0.0:1784938587.720128:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a061fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d9 expref: 16 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.720138:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326028288 00000100:00100000:0.0:1784938587.720141:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326028288 00010000:00010000:0.0:1784938587.720152:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ccbc2647/0xcd9d312a94a0627f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d542d expref: 13 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.720164:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326028416 00000100:00100000:0.0:1784938587.720166:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326028416 00010000:00010000:0.0:1784938587.720177:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0628d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5434 expref: 14 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.720188:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326028544 00000100:00100000:0.0:1784938587.720190:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326028544 00010000:00010000:0.0:1784938587.720202:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a06239 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5403 expref: 17 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.720218:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 399 00000100:00100000:0.0:1784938587.720235:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+17:10024:x1871643326027648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.720250:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.720256:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a0625c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d540a expref: 17 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720267:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a0625c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d540a expref: 17 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720292:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a0625c lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d540a expref: 17 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720308:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.720312:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.720319:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720330:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720354:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938587.720379:0:19394:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.720385:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+16:10024:x1871643326027648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 151us (1698us total) trans 0 rc 0/0 00010000:00010000:2.0:1784938587.720389:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.720392:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 399 00010000:00010000:2.0:1784938587.720400:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.720407:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 400 00010000:00010000:2.0:1784938587.720408:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.720413:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+15:10024:x1871643326027776:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938587.720425:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938587.720429:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.720434:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a06232 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53fc expref: 15 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720443:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a06232 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53fc expref: 15 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720455:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.720458:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.720462:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720469:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720480:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.720497:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+15:10024:x1871643326027776:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 83us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.720502:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 400 00000100:00100000:0.0:1784938587.720514:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 401 00000100:00100000:0.0:1784938587.720519:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+14:10026:x1871643326028032:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.720526:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.720530:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a06286 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5426 expref: 14 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720549:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a06286 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5426 expref: 14 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720563:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.720566:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.720569:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720577:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720588:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.720604:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+14:10026:x1871643326028032:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 85us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.720610:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 401 00000100:00100000:0.0:1784938587.720621:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 402 00000100:00100000:0.0:1784938587.720626:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+13:10026:x1871643326027904:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.720633:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.720638:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046a76218/0xcd9d312a94a06278 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d541f expref: 13 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720646:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046a76218/0xcd9d312a94a06278 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d541f expref: 13 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720668:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046a76218/0xcd9d312a94a06278 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d541f expref: 13 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720677:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.720680:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.720683:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720690:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720706:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.720725:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+12:10026:x1871643326027904:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 98us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.720731:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 402 00000100:00100000:0.0:1784938587.720744:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 403 00000100:00100000:0.0:1784938587.720768:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+14:10023:x1871643326028160:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.720777:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.720782:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a061fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d9 expref: 14 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720793:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a061fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d9 expref: 14 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720817:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a061fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0xbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53d9 expref: 14 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720841:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.720844:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.720848:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720855:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720875:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.720894:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+13:10023:x1871643326028160:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 145us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.720900:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 403 00000100:00100000:0.0:1784938587.720913:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 404 00000100:00100000:0.0:1784938587.720919:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+11:10023:x1871643326028288:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.720926:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.720930:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ccbc2647/0xcd9d312a94a0627f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d542d expref: 11 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720940:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ccbc2647/0xcd9d312a94a0627f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d542d expref: 11 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720961:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccbc2647/0xcd9d312a94a0627f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d542d expref: 11 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720970:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.720973:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.720976:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.720983:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721001:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.721019:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+10:10023:x1871643326028288:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 100us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.721025:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 404 00000100:00100000:0.0:1784938587.721038:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 405 00000100:00100000:0.0:1784938587.721044:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974710d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+9:10026:x1871643326028416:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.721051:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.721056:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0628d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5434 expref: 9 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721064:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0628d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5434 expref: 9 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721092:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0628d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5434 expref: 9 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721105:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.721108:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.721112:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721119:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721138:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.721158:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974710d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+8:10026:x1871643326028416:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 114us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.721164:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 405 00000100:00100000:0.0:1784938587.721193:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 406 00000100:00100000:0.0:1784938587.721199:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+12:10025:x1871643326028544:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.721208:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.721213:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a06239 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5403 expref: 12 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721223:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a06239 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5403 expref: 12 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721247:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a06239 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5403 expref: 12 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721258:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.721261:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.721266:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721273:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721290:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.721308:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+11:10025:x1871643326028544:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 109us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.721315:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 406 00010000:00010000:0.0:1784938587.721338:0:15288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938587.721344:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721353:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.721358:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721367:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721390:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721397:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abdd541d/0xcd9d312a94a06b2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721418:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.721420:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.721421:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.721433:0:19395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721441:0:19395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721449:0:19395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721456:0:19395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.721473:0:19395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938587.722092:0:19394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:12804:x1871643342499456:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 24104us (24766us total) trans 4294967559 rc 0/0 00000100:00100000:2.0:1784938587.722102:0:19394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 916 00000100:00100000:2.0:1784938587.722121:0:19394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342500992 00000100:00100000:2.0:1784938587.722127:0:19394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342500992 00000100:00100000:2.0:1784938587.722146:0:19394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342500864 00000100:00100000:2.0:1784938587.722149:0:19394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342500864 00000100:00100000:2.0:1784938587.722160:0:19394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 922 00000100:00100000:2.0:1784938587.722166:0:19394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:12803:x1871643342500992:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938587.725060:0:19394:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:165 count 1 00010000:00010000:2.0:1784938587.725102:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.725128:0:19394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641e7057/0xcd9d312a94a062b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5449 expref: 7 pid: 16105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.725137:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa5:0x0].0x0 since=10s v=(0 0) 00010000:00010000:2.0:1784938587.725143:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938587.725147:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.725368:0:19392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 923 00000100:00100000:3.0:1784938587.725386:0:19392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:12804:x1871643342500864:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938587.725402:0:19392:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:173 count 1 00010000:00010000:3.0:1784938587.725415:0:19392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.725427:0:19392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007bf5cb55/0xcd9d312a94a0629b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d543b expref: 7 pid: 19405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.725452:0:19392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xad:0x0].0x0 since=10s v=(0 0) 00010000:00010000:3.0:1784938587.725456:0:19392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.725460:0:19392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.725481:0:19392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007bf5cb55/0xcd9d312a94a0629b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d543b expref: 7 pid: 19405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.725495:0:19392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007bf5cb55/0xcd9d312a94a0629b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d543b expref: 7 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.725509:0:19392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19392:1871643342501760:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938587.725571:0:19394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000641e7057/0xcd9d312a94a062b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5449 expref: 7 pid: 16105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938587.725578:0:19392:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21ae40 going to sleep for 11 seconds 00010000:00010000:2.0:1784938587.725581:0:19394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000641e7057/0xcd9d312a94a062b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5449 expref: 7 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938587.725591:0:19394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602690700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:19394:1871643342501632:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938587.725612:0:19394:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460935f3c0 going to sleep for 11 seconds 00000004:00080000:2.0:1784938587.725953:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e7800/2, rc 0, transno 4294967559 00000100:00100000:2.0:1784938587.725970:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342499456:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938587.726018:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938587.726977:0:16102:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc89c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:16102:1871643342501120:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938587.727002:0:16102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.727359:0:17487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a06232 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d53fc expref: 10 pid: 19396 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.727376:0:17487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17487:1871643342499328:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938587.727391:0:17487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.727419:0:17487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.727425:0:17487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.727435:0:17487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.727442:0:17487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.727462:0:17487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1784938587.728197:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1784938587.728290:0:19390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.728300:0:19390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.728316:0:19390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.728322:0:19390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.728338:0:19390:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1784938587.729134:0:17487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:12802:x1871643342499072:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 32811us (33348us total) trans 4294967560 rc 0/0 00000100:00100000:1.0:1784938587.729145:0:17487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 915 00010000:00010000:1.0:1784938587.729184:0:19393:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.729195:0:19393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.729204:0:19393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.729223:0:19393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.729242:0:19393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1784938587.729478:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:12804:x1871643342498304:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 42298us (45888us total) trans 4294967565 rc 0/0 00000100:00100000:0.0:1784938587.729486:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 913 00010000:00010000:0.0:1784938587.729511:0:19405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.729520:0:19405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.729528:0:19405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.729534:0:19405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.729543:0:19405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1784938587.729680:0:19405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473bab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+20:12804:x1871643342498944:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 37226us (45195us total) trans 4294967566 rc 0/0 00000100:00100000:0.0:1784938587.729694:0:19405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 914 00000100:00100000:0.0:1784938587.729955:0:16104:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:16104:1871643342501504:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938587.729976:0:16104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.729995:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784938587.730002:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730010:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148b800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.730014:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730022:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730041:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730048:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004fd61ce/0xcd9d312a94a06b31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730068:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784938587.730072:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730091:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.730096:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730104:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730115:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730122:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3a695dc/0xcd9d312a94a06b23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730137:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938587.730140:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730147:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.730150:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730158:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730167:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730180:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000596d7323/0xcd9d312a94a06b3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730194:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938587.730197:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730204:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.730207:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730215:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730226:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730233:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be945d25/0xcd9d312a94a06b07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730245:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938587.730247:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730253:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.730264:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730272:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730282:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730289:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000066307fb/0xcd9d312a94a06b46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730302:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.730304:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.730306:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.730313:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.730318:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938587.730541:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326028928 00000100:00100000:0.0:1784938587.730549:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326028928 00010000:00010000:0.0:1784938587.730583:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a06294 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5450 expref: 10 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.730609:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326028800 00000100:00100000:0.0:1784938587.730612:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326028800 00010000:00010000:0.0:1784938587.730625:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a0626a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5411 expref: 11 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.730642:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 407 00000100:00100000:0.0:1784938587.730658:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+11:10025:x1871643326028928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.730672:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.730678:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a06294 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5450 expref: 11 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730688:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a06294 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5450 expref: 11 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730705:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a06294 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5450 expref: 11 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730717:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.730721:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.730727:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730737:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730784:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.730837:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+10:10025:x1871643326028928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 167us (4807us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.730845:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 407 00000100:00100000:0.0:1784938587.730861:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 408 00000100:00100000:0.0:1784938587.730868:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+9:10024:x1871643326028800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.730886:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.730892:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a0626a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5411 expref: 9 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730902:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a0626a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5411 expref: 9 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730914:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.730917:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.730921:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730929:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730941:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.730959:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+9:10024:x1871643326028800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 92us (4899us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.730965:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 408 00010000:00010000:0.0:1784938587.730984:0:16104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.730992:0:16104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.731002:0:16104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.731016:0:16104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.731032:0:16104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938587.731343:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938587.731431:0:19398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19398:1871643342501248:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938587.731450:0:19398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.731478:0:16104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974717ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:12804:x1871643342500736:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 13068us (22332us total) trans 4294967561 rc 0/0 00000100:00100000:0.0:1784938587.731486:0:16104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 921 00010000:00010000:0.0:1784938587.731508:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938587.731514:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.731521:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938587.731524:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.731532:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.731543:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.731550:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a06b69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.731565:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.731572:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938587.731574:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938587.731583:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326028672 00000100:00100000:0.0:1784938587.731588:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326028672 00010000:00010000:0.0:1784938587.731604:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a06271 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5418 expref: 9 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938587.731610:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974704025f80/2, rc 0, transno 4294967561 00000100:00100000:2.0:1784938587.731616:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342500736:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1784938587.731619:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 409 00000100:00100000:0.0:1784938587.731625:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+9:10024:x1871643326028672:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.731633:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.731637:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a06271 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5418 expref: 9 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.731648:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a06271 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5418 expref: 9 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.731661:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a06271 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5418 expref: 9 pid: 19398 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.731671:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.731675:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.731680:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.731688:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938587.731694:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974609ea3800/2, rc 0, transno 4294967565 00000100:00100000:2.0:1784938587.731699:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342498304:192.168.202.104@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1784938587.731718:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.731737:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+8:10024:x1871643326028672:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 112us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.731743:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 409 00000004:00080000:0.0:1784938587.731789:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e6d80/2, rc 0, transno 4294967560 00000004:00080000:2.0:1784938587.731790:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e4700/2, rc 0, transno 4294967566 00000100:00100000:2.0:1784938587.731796:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342498944:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:0.0:1784938587.731796:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342499072:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938587.732160:0:19393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:12803:x1871643342497280:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 58476us (59046us total) trans 4294967562 rc 0/0 00000100:00100000:1.0:1784938587.732169:0:19393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 908 00010000:00010000:1.0:1784938587.732195:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938587.732275:0:16105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a0626a lrc: 0/0,0 mode: --/PR res: [0x280000400:0xaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5411 expref: 7 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.732287:0:16105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:16105:1871643342501376:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938587.732301:0:16105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.732309:0:16105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.732316:0:16105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.732326:0:16105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.732343:0:16105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.732357:0:16105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938587.732686:0:16105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974717ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:12805:x1871643342500352:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 14798us (23574us total) trans 4294967563 rc 0/0 00000100:00100000:1.0:1784938587.732693:0:16105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 920 00010000:00010000:1.0:1784938587.732719:0:19388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.732728:0:19388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.732737:0:19388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.732744:0:19388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.732787:0:19388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1784938587.732921:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974717eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:12802:x1871643342499200:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 25887us (28576us total) trans 4294967564 rc 0/0 00000100:00100000:1.0:1784938587.732928:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 917 00010000:00010000:1.0:1784938587.732944:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938587.732950:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.732964:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938587.732967:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.732975:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.732991:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.732998:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a06b62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.733012:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938587.733014:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.733020:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938587.733023:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.733029:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.733037:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.733052:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a06b4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.733065:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938587.733067:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938587.733069:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938587.733091:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342501888:192.168.202.104@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1784938587.733174:0:19397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a06286 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5426 expref: 7 pid: 19395 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.733187:0:19397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:19397:1871643342499840:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938587.733204:0:19397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.733213:0:19397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.733219:0:19397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.733228:0:19397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.733234:0:19397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.733254:0:19397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938587.733491:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938587.733623:0:19397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:12803:x1871643342498176:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 47721us (53114us total) trans 4294967567 rc 0/0 00000100:00100000:1.0:1784938587.733631:0:19397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 912 00000100:00100000:1.0:1784938587.733648:0:19397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342501888 00000100:00100000:1.0:1784938587.733653:0:19397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342501888 00000100:00100000:1.0:1784938587.733690:0:19397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 924 00000100:00100000:1.0:1784938587.733698:0:19397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+28:12803:x1871643342501888:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938587.733726:0:19397:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:184 count 1 00010000:00010000:1.0:1784938587.733776:0:19397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.733793:0:19397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a55156e/0xcd9d312a94a06079 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5369 expref: 6 pid: 19388 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.733801:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb8:0x0].0x0 since=10s v=(0 0) 00010000:00010000:1.0:1784938587.733804:0:19397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.733809:0:19397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 4/0,1 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.734963:0:19397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a55156e/0xcd9d312a94a06079 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5369 expref: 6 pid: 19388 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.734982:0:19397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a55156e/0xcd9d312a94a06079 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5369 expref: 6 pid: 19388 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.735017:0:19397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:19397:1871643342502016:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938587.735090:0:19397:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747057f0240 going to sleep for 11 seconds 00000004:00080000:1.0:1784938587.735143:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97473a635f80/2, rc 0, transno 4294967562 00000100:00100000:1.0:1784938587.735150:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342497280:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938587.735201:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1784938587.738382:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938587.738399:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.738415:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938587.738420:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.738463:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.738485:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.738492:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca410adc/0xcd9d312a94a06b38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.738521:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938587.738523:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938587.738526:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938587.738533:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784938587.738600:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472a1e6680/2, rc 0, transno 4294967564 00000100:00100000:3.0:1784938587.738611:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342499200:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938587.738639:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326029056 00000100:00100000:3.0:1784938587.738645:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326029056 00010000:00010000:3.0:1784938587.738681:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a062be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5442 expref: 7 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.739049:0:16102:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.739061:0:16102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.739072:0:16102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.739080:0:16102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.739110:0:16102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938587.739196:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938587.739203:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.739211:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938587.739214:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.739223:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.739236:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.739258:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aed092f4/0xcd9d312a94a06b54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.739276:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.739278:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.739280:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938587.739728:0:16102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974717ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:12802:x1871643342500480:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 29472us (30652us total) trans 4294967565 rc 0/0 00000100:00100000:0.0:1784938587.739739:0:16102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 918 00000004:00080000:1.0:1784938587.740021:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974704024e00/2, rc 0, transno 4294967563 00000100:00100000:1.0:1784938587.740028:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342500352:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:1.0:1784938587.740045:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97472ff22300/2, rc 0, transno 4294967562 00000100:00100000:1.0:1784938587.740050:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472ff22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342493824:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:1.0:1784938587.740058:0:12805:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974707fb3b80/2, rc 0, transno 4294967561 00000100:00100000:1.0:1784938587.740062:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974707fb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342494336:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:1.0:1784938587.740090:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974609ea3480/2, rc 0, transno 4294967567 00000100:00100000:1.0:1784938587.740094:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342498176:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938587.740375:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 410 00000100:00100000:3.0:1784938587.740389:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+7:10026:x1871643326029056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938587.740406:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938587.740414:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a062be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5442 expref: 7 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.740506:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a062be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5442 expref: 7 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.740527:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a062be lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5442 expref: 7 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.740542:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.740548:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938587.740554:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.740563:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938587.740587:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938587.740618:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+6:10026:x1871643326029056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 234us (5417us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938587.740624:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 410 00000100:00100000:3.0:1784938587.740699:0:19395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:12803:x1871643342497024:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 67044us (67700us total) trans 4294967564 rc 0/0 00000100:00100000:3.0:1784938587.740707:0:19395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 907 00000100:00100000:2.0:1784938587.740741:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938587.740882:0:19392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19392:1871643342501760:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938587.740899:0:19392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.740930:0:19398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.740938:0:19398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.740948:0:19398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.740956:0:19398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.740973:0:19398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1784938587.741019:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974609ea2300/2, rc 0, transno 4294967564 00000100:00100000:1.0:1784938587.741024:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342497024:192.168.202.104@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1784938587.741037:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938587.741043:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.741050:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938587.741053:0:17786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.741070:0:17786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.741082:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.741090:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000238945ed/0xcd9d312a94a06b5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.741105:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938587.741107:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938587.741108:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938587.741174:0:19398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974717eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+29:12802:x1871643342500608:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 23599us (32076us total) trans 4294967566 rc 0/0 00000100:00100000:2.0:1784938587.741197:0:19398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 919 00000004:00080000:0.0:1784938587.741212:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974704027800/2, rc 0, transno 4294967565 00000100:00100000:0.0:1784938587.741218:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342500480:192.168.202.104@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938587.741226:0:19394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602690700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:19394:1871643342501632:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938587.741238:0:19394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.741258:0:15286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326029184 00000100:00100000:0.0:1784938587.741265:0:15286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326029184 00010000:00010000:0.0:1784938587.741291:0:15286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007bf5cb55/0xcd9d312a94a0629b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d543b expref: 7 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938587.741326:0:15286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 411 00000100:00100000:0.0:1784938587.741334:0:15286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcde919f-d270-4443-90d5-314650605a2d+7:10024:x1871643326029184:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938587.741344:0:15286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938587.741349:0:15286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007bf5cb55/0xcd9d312a94a0629b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d543b expref: 7 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.741359:0:15286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007bf5cb55/0xcd9d312a94a0629b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d543b expref: 7 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.741374:0:15286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bf5cb55/0xcd9d312a94a0629b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d543b expref: 7 pid: 19405 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.741387:0:15286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.741390:0:15286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938587.741394:0:15286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.741401:0:15286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.741418:0:15286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938587.741448:0:15286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcde919f-d270-4443-90d5-314650605a2d+6:10024:x1871643326029184:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 115us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.741455:0:15286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 411 00010000:00010000:0.0:1784938587.741474:0:19392:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.741482:0:19392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.741490:0:19392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.741496:0:19392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938587.741509:0:19392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938587.743269:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938587.743282:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.743295:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938587.743300:0:18251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.743311:0:18251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.743331:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.743355:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020106674/0xcd9d312a94a06b77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.743383:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938587.743385:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938587.743386:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938587.744102:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938587.744124:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938587.744144:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326029312 00000100:00100000:1.0:1784938587.744151:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326029312 00010000:00010000:1.0:1784938587.744182:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000641e7057/0xcd9d312a94a062b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5449 expref: 6 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.744205:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326029440 00000100:00100000:1.0:1784938587.744207:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326029440 00010000:00010000:1.0:1784938587.744218:0:15287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a55156e/0xcd9d312a94a06079 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5369 expref: 6 pid: 19388 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938587.744234:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 412 00000100:00100000:1.0:1784938587.744241:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974710d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+6:10023:x1871643326029312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938587.744254:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938587.744258:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000641e7057/0xcd9d312a94a062b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5449 expref: 6 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.744272:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000641e7057/0xcd9d312a94a062b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5449 expref: 6 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.744296:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641e7057/0xcd9d312a94a062b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5449 expref: 6 pid: 16105 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.744309:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.744313:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.744319:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.744329:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.744350:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938587.744392:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974710d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+5:10023:x1871643326029312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 151us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938587.744399:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 412 00000100:00100000:1.0:1784938587.744438:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 413 00000100:00100000:1.0:1784938587.744444:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+6:10025:x1871643326029440:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938587.744452:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938587.744456:0:15287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a55156e/0xcd9d312a94a06079 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5369 expref: 6 pid: 19388 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.744466:0:15287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a55156e/0xcd9d312a94a06079 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5369 expref: 6 pid: 19388 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.744490:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.744493:0:15287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938587.744498:0:15287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.744505:0:15287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938587.744515:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938587.744531:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcde919f-d270-4443-90d5-314650605a2d+6:10025:x1871643326029440:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 88us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938587.744537:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 413 00010000:00010000:2.0:1784938587.745007:0:19397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a55156e/0xcd9d312a94a06079 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5369 expref: 5 pid: 19388 timeout: 841 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938587.745021:0:19397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:19397:1871643342502016:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938587.745040:0:19397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745050:0:19397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745057:0:19397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745067:0:19397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745074:0:19397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745102:0:19397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938587.745589:0:19397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+29:12803:x1871643342501888:12345-192.168.202.104@tcp:6:osp-syn-1-0.0 Request processed in 11890us (12098us total) trans 4294967567 rc 0/0 00000100:00100000:2.0:1784938587.745598:0:19397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 924 00010000:00010000:2.0:1784938587.745624:0:15288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938587.745630:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745639:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938587.745643:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745653:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745668:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745675:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a06b7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745694:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.745696:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.745697:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.745707:0:19394:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745720:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745728:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745735:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.745746:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938587.746075:0:19394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:12803:x1871643342500992:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 23907us (26610us total) trans 4294967568 rc 0/0 00000100:00100000:2.0:1784938587.746083:0:19394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 922 00010000:00010000:2.0:1784938587.746107:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938587.746112:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.746118:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938587.746121:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.746128:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.746140:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.746154:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020ec6606/0xcd9d312a94a06b70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938587.746169:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.746171:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938587.746172:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938587.747227:0:19392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:12804:x1871643342500864:12345-192.168.202.104@tcp:6:osp-syn-0-0.0 Request processed in 21844us (27525us total) trans 4294967569 rc 0/0 00000100:00100000:0.0:1784938587.747237:0:19392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 923 00000004:00080000:0.0:1784938587.747292:0:12802:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974704027b80/2, rc 0, transno 4294967566 00000100:00100000:0.0:1784938587.747299:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342500608:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:2.0:1784938587.748405:0:12804:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601f3c380/2, rc 0, transno 4294967569 00000100:00100000:2.0:1784938587.748416:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342500864:192.168.202.104@tcp:6:osp-syn-0-0.0 00000004:00080000:0.0:1784938587.748490:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974704024380/2, rc 0, transno 4294967567 00000100:00100000:0.0:1784938587.748496:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342501888:192.168.202.104@tcp:6:osp-syn-1-0.0 00000004:00080000:0.0:1784938587.748504:0:12803:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974601f3f480/2, rc 0, transno 4294967568 00000100:00100000:0.0:1784938587.748507:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342500992:192.168.202.104@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938587.766399:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938587.766454:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326029568 00000100:00100000:3.0:1784938587.766464:0:24715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326029568 00000100:00100000:1.0:1784938587.766484:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938587.766511:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:3.0:1784938587.766521:0:24715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974740e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10026:x1871643326029568:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784938587.766630:0:24721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326029696 00000100:00100000:0.0:1784938587.766635:0:24721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326029696 00000100:00100000:0.0:1784938587.766677:0:24721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:0.0:1784938587.766684:0:24721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcde919f-d270-4443-90d5-314650605a2d+7:10024:x1871643326029696:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784938587.766803:0:24715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974740e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10026:x1871643326029568:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 282us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938587.766811:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:0.0:1784938587.768172:0:24721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcde919f-d270-4443-90d5-314650605a2d+7:10024:x1871643326029696:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1479us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938587.768184:0:24721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00080000:0.0:1784938587.768218:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784938588.027896:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938588.532115:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938588.532144:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342502144:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938588.532396:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938588.532408:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342502272:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938588.532868:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938588.532908:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938588.532931:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342502272 00000100:00100000:1.0:1784938588.532938:0:16107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342502144 00000100:00100000:3.0:1784938588.532940:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342502272 00000100:00100000:1.0:1784938588.532944:0:16107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342502144 00000100:00100000:3.0:1784938588.533002:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 113 00000100:00100000:3.0:1784938588.533014:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:12804:x1871643342502272:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938588.533052:0:19601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43319296 pending 0 free 389021696 avail 386924544 00000100:00100000:3.0:1784938588.533109:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:12804:x1871643342502272:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 97us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938588.533116:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 113 00000100:00100000:1.0:1784938588.540179:0:16107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 114 00000100:00100000:1.0:1784938588.540198:0:16107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+19:12805:x1871643342502144:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938588.540242:0:16107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43319296 pending 0 free 389021696 avail 386924544 00000100:00100000:1.0:1784938588.540577:0:16107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+19:12805:x1871643342502144:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 134us (7414us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938588.540597:0:16107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 114 00000100:00100000:2.0:1784938588.542270:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342502272:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938588.546720:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342502144:192.168.202.104@tcp:13:osp-pre-0-0.0 00000001:00080000:1.0:1784938588.617735:0:16101:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967569 is committed 00000100:00100000:1.0:1784938589.044994:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66ce0d8a-9177-486f-adae-cb202cd372dd:12802:1871643342502400:0@lo:400:kworker.0 00000100:00100000:1.0:1784938589.045089:0:12802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938589.045147:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938589.045156:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342502528:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938589.045224:0:24739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342502400 00000100:00100000:1.0:1784938589.045232:0:24739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342502400 00000100:00100000:1.0:1784938589.045288:0:24739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784938589.045298:0:24739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974740e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12802:x1871643342502400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938589.045358:0:24739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974740e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12802:x1871643342502400:12345-0@lo:400:kworker.0 Request processed in 61us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938589.045366:0:24739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784938589.045420:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66ce0d8a-9177-486f-adae-cb202cd372dd:12802:1871643342502400:0@lo:400:kworker.0 00000100:00100000:2.0:1784938589.047627:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:12804:1871643342502656:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938589.047733:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938589.047742:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342502784:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938589.049157:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938589.049186:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938589.049208:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938589.049241:0:24722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342502528 00000100:00100000:2.0:1784938589.049250:0:24722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342502528 00000100:00100000:2.0:1784938589.049308:0:24722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342502656 00000100:00100000:2.0:1784938589.049312:0:24722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342502656 00000100:00100000:2.0:1784938589.049327:0:24722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342502784 00000100:00100000:2.0:1784938589.049330:0:24722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342502784 00000100:00100000:2.0:1784938589.049346:0:24722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 27 00000100:00100000:2.0:1784938589.049370:0:24722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342502528:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938589.049439:0:24722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342502528:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 71us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938589.049447:0:24722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 27 00000100:00100000:2.0:1784938589.049468:0:24722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 28 00000100:00100000:2.0:1784938589.049474:0:24722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:12804:x1871643342502656:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938589.049504:0:24722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:12804:x1871643342502656:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938589.049510:0:24722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 28 00000100:00100000:2.0:1784938589.049524:0:24722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 29 00000100:00100000:2.0:1784938589.049529:0:24722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342502784:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938589.049552:0:24722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342502784:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 23us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938589.049558:0:24722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 29 00000100:00080000:2.0:1784938589.049578:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938589.049741:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342502784:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938589.049783:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:12804:1871643342502656:192.168.202.104@tcp:400:kworker.0 00010000:00010000:3.0:1784938589.050730:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938589.051691:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342502528:192.168.202.104@tcp:400:kworker.0 00000001:00080000:3.0:1784938589.187146:0:16955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967565 is committed 00000001:00080000:3.0:1784938589.187213:0:16955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967567 is committed 00010000:00010000:2.0:1784938590.070575:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938591.092246:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938592.118379:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938592.888827:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938592.888944:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938592.889585:0:24722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326029952 00000100:00100000:1.0:1784938592.889602:0:24722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326029952 00000100:00100000:1.0:1784938592.890305:0:24722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:1.0:1784938592.890333:0:24722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcde919f-d270-4443-90d5-314650605a2d+7:10025:x1871643326029952:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938592.890483:0:24722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcde919f-d270-4443-90d5-314650605a2d+7:10025:x1871643326029952:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 160us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938592.890494:0:24722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:1.0:1784938592.892268:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938592.892310:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938592.892361:0:16104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326030080 00000100:00100000:1.0:1784938592.892374:0:16104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326030080 00000100:00100000:1.0:1784938592.892450:0:16104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326030208 00000100:00100000:1.0:1784938592.892454:0:16104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326030208 00000100:00100000:1.0:1784938592.892484:0:16104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:1.0:1784938592.892499:0:16104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcde919f-d270-4443-90d5-314650605a2d+5:10025:x1871643326030080:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938592.892582:0:16104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcde919f-d270-4443-90d5-314650605a2d+5:10025:x1871643326030080:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 88us (3641us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938592.892590:0:16104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:1.0:1784938592.892607:0:16104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:1.0:1784938592.892626:0:16104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcde919f-d270-4443-90d5-314650605a2d+5:10023:x1871643326030208:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938592.892652:0:16104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcde919f-d270-4443-90d5-314650605a2d+5:10023:x1871643326030208:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 39us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938592.892659:0:16104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:1.0:1784938592.892680:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326029824 00000100:00100000:1.0:1784938592.892683:0:24715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326029824 00000100:00100000:1.0:1784938592.892713:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:1.0:1784938592.892720:0:24715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974740e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10023:x1871643326029824:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938592.892748:0:24715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974740e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10023:x1871643326029824:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938592.892775:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00080000:3.0:1784938592.902194:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938592.902209:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938592.902214:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784938593.139146:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938593.652445:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938593.652486:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342502912:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938593.654915:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938593.654946:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342503040:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938593.655441:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938593.655507:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938593.655547:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342502912 00000100:00100000:0.0:1784938593.655557:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342502912 00000100:00100000:0.0:1784938593.655626:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342503040 00000100:00100000:0.0:1784938593.655630:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342503040 00000100:00100000:0.0:1784938593.655651:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 115 00000100:00100000:0.0:1784938593.655661:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342502912:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938593.655709:0:19601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43319296 pending 0 free 390070272 avail 387973120 00000100:00100000:0.0:1784938593.655808:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342502912:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 146us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938593.655817:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 115 00000100:00100000:0.0:1784938593.655839:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 116 00000100:00100000:0.0:1784938593.655846:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342503040:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938593.655886:0:19601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43319296 pending 0 free 390070272 avail 387973120 00000100:00100000:0.0:1784938593.655913:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342503040:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 68us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938593.655919:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 116 00000100:00080000:0.0:1784938593.655938:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938593.655943:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938593.656072:0:12803:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967569 gen 2 00000004:00080000:0.0:1784938593.656080:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974607d61f80, transno 4294967556 00000004:00080000:0.0:1784938593.656093:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472ff20a80, transno 4294967557 00000004:00080000:0.0:1784938593.656096:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472ff21880, transno 4294967558 00000004:00080000:0.0:1784938593.656100:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472ff20e00, transno 4294967559 00000004:00080000:0.0:1784938593.656103:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472ff21c00, transno 4294967560 00000004:00080000:0.0:1784938593.656106:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974707fb3b80, transno 4294967561 00000004:00080000:0.0:1784938593.656109:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472ff22300, transno 4294967562 00000004:00080000:0.0:1784938593.656112:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974607d60700, transno 4294967563 00000004:00080000:0.0:1784938593.656114:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974609ea2300, transno 4294967564 00000004:00080000:0.0:1784938593.656117:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974609ea3800, transno 4294967565 00000004:00080000:0.0:1784938593.656120:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e4700, transno 4294967566 00000004:00080000:0.0:1784938593.656122:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974609ea3480, transno 4294967567 00000004:00080000:0.0:1784938593.656126:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601f3f480, transno 4294967568 00000004:00080000:0.0:1784938593.656129:0:12803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974601f3c380, transno 4294967569 00000100:00100000:0.0:1784938593.656145:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342502912:192.168.202.104@tcp:13:osp-pre-0-0.0 00000004:00080000:0.0:1784938593.656690:0:24744:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 14 done 00000100:00100000:0.0:1784938593.656723:0:12802:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967567 gen 2 00000004:00080000:0.0:1784938593.656727:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e7100, transno 4294967544 00000004:00080000:0.0:1784938593.656739:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e6a00, transno 4294967545 00000004:00080000:0.0:1784938593.656743:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e6300, transno 4294967546 00000004:00080000:0.0:1784938593.656789:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e5500, transno 4294967547 00000004:00080000:0.0:1784938593.656792:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e5f80, transno 4294967548 00000004:00080000:0.0:1784938593.656795:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e4e00, transno 4294967549 00000004:00080000:0.0:1784938593.656798:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e7b80, transno 4294967550 00000004:00080000:0.0:1784938593.656802:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e5880, transno 4294967551 00000004:00080000:0.0:1784938593.656805:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97473a637b80, transno 4294967552 00000004:00080000:0.0:1784938593.656807:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97473a635500, transno 4294967553 00000004:00080000:0.0:1784938593.656810:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97473a634a80, transno 4294967554 00000004:00080000:0.0:1784938593.656813:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97473a634380, transno 4294967555 00000004:00080000:0.0:1784938593.656816:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97473a634700, transno 4294967556 00000004:00080000:0.0:1784938593.656819:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97473a636680, transno 4294967557 00000004:00080000:0.0:1784938593.656822:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97473a635180, transno 4294967558 00000004:00080000:0.0:1784938593.656825:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e7800, transno 4294967559 00000004:00080000:0.0:1784938593.656828:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e6d80, transno 4294967560 00000004:00080000:0.0:1784938593.656831:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974704025f80, transno 4294967561 00000004:00080000:0.0:1784938593.656833:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97473a635f80, transno 4294967562 00000004:00080000:0.0:1784938593.656836:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974704024e00, transno 4294967563 00000004:00080000:0.0:1784938593.656838:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97472a1e6680, transno 4294967564 00000004:00080000:0.0:1784938593.656841:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974704027800, transno 4294967565 00000004:00080000:0.0:1784938593.656845:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974704027b80, transno 4294967566 00000004:00080000:0.0:1784938593.656847:0:12802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974704024380, transno 4294967567 00000100:00100000:0.0:1784938593.656860:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342503040:192.168.202.104@tcp:13:osp-pre-1-0.0 00000004:00080000:0.0:1784938593.657199:0:24746:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 24 done 00000001:02000400:0.0:1784938593.858221:0:26753:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-scrub test 4b: Auto trigger OI scrub if bad OI mapping was found (2) ========================================================== 20:16:32 (1784938592) 00010000:00010000:2.0:1784938594.163018:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938594.163318:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342503168:0@lo:400:kworker.0 00000100:00100000:2.0:1784938594.163440:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938594.163948:0:24739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342503168 00000100:00100000:0.0:1784938594.163960:0:24739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342503168 00000100:00100000:0.0:1784938594.164022:0:24739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784938594.164034:0:24739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974740e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12804:x1871643342503168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938594.167612:0:24739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974740e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12804:x1871643342503168:12345-0@lo:400:kworker.0 Request processed in 3565us (4157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938594.167632:0:24739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784938594.174984:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342503296:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938594.175295:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:12803:1871643342503552:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938594.175340:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938594.175348:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342503424:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938594.175663:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938594.175784:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938594.175813:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938594.175851:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342503552 00000100:00100000:0.0:1784938594.175861:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342503552 00000100:00100000:0.0:1784938594.175913:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342503296 00000100:00100000:0.0:1784938594.175917:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342503296 00000100:00100000:0.0:1784938594.175941:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342503424 00000100:00100000:0.0:1784938594.175944:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342503424 00000100:00100000:0.0:1784938594.175962:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 31 00000100:00100000:0.0:1784938594.175971:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12803:x1871643342503552:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938594.176029:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12803:x1871643342503552:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 59us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938594.176038:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 31 00000100:00100000:0.0:1784938594.176062:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 32 00000100:00100000:0.0:1784938594.176069:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342503296:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938594.176099:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342503296:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938594.176105:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 32 00000100:00100000:0.0:1784938594.176116:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 33 00000100:00100000:0.0:1784938594.176123:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342503424:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938594.176146:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342503424:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 24us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938594.176176:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 33 00000100:00080000:0.0:1784938594.176201:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938594.176521:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342503424:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938594.176543:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:12803:1871643342503552:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938594.176650:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342503296:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938594.177244:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342503168:0@lo:400:kworker.0 00010000:00010000:1.0:1784938595.187227:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784938595.805573:0:26801:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-scrub test_4b ldiskfs special test 00010000:00010000:1.0:1784938596.212641:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938597.234995:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938597.235245:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342504064:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938597.235418:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342503808:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938597.235730:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938597.235739:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342503936:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938597.235819:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342503680:0@lo:400:kworker.0 00000100:00100000:0.0:1784938597.235890:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938597.235947:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342504192:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938597.236144:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938597.236227:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938597.236253:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938597.236290:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342503936 00000100:00100000:0.0:1784938597.236300:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342503936 00000100:00100000:0.0:1784938597.236369:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 34 00000100:00100000:0.0:1784938597.236380:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342503936:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938597.236436:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342503936:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 57us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938597.236447:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 34 00000100:00100000:0.0:1784938597.236475:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342504064 00000100:00100000:0.0:1784938597.236479:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342504064 00000100:00100000:0.0:1784938597.236507:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342504192 00000100:00100000:0.0:1784938597.236510:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342504192 00000100:00100000:0.0:1784938597.236534:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 89 00000100:00100000:0.0:1784938597.236540:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342504064:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938597.236571:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342504064:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 31us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938597.236579:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 89 00000100:00100000:0.0:1784938597.236589:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 90 00000100:00100000:0.0:1784938597.236610:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342504192:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938597.236637:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342504192:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938597.236643:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 90 00000100:00080000:0.0:1784938597.236663:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938597.236668:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938597.236671:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938597.236887:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342504192:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938597.236924:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342503936:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938597.236936:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342504064:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938597.237051:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342503680 00000100:00100000:2.0:1784938597.237058:0:24715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342503680 00000100:00100000:2.0:1784938597.237093:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784938597.237100:0:24715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974740e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12804:x1871643342503680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938597.237145:0:24715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974740e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12804:x1871643342503680:12345-0@lo:400:kworker.0 Request processed in 45us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938597.237152:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784938597.237244:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342503680:0@lo:400:kworker.0 00000100:00100000:3.0:1784938597.238247:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342504320:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938597.238858:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938597.238942:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938597.239048:0:24721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342503808 00000100:00100000:3.0:1784938597.239058:0:24721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342503808 00000100:00100000:0.0:1784938597.239147:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342504320 00000100:00100000:0.0:1784938597.239153:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342504320 00000100:00100000:3.0:1784938597.239167:0:24721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 35 00000100:00100000:3.0:1784938597.239179:0:24721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342503808:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938597.239183:0:24723:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784938597.239194:0:24723:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1784938597.239215:0:24722:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784938597.239227:0:24722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 36 00000100:00100000:0.0:1784938597.239235:0:24722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342504320:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938597.239244:0:24721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342503808:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 66us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938597.239252:0:24721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 35 00000100:00100000:0.0:1784938597.239273:0:24722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342504320:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 37us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938597.239282:0:24722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 36 00000100:00100000:3.0:1784938597.239735:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342503808:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938597.239793:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342504320:192.168.202.104@tcp:400:kworker.0 00000100:00080000:2.0:1784938597.239939:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1784938597.757313:0:26850:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-scrub test 4c: Auto trigger OI scrub if bad OI mapping was found (3) ========================================================== 20:16:36 (1784938596) 00000100:00100000:0.0:1784938598.016498:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938598.016580:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938598.016605:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938598.016634:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938598.016705:0:24717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326030336 00000100:00100000:1.0:1784938598.016719:0:24717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326030336 00000100:00100000:1.0:1784938598.016838:0:24717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:1.0:1784938598.016847:0:24717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974740e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10023:x1871643326030336:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938598.016923:0:24717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974740e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10023:x1871643326030336:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 79us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938598.016929:0:24717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:2.0:1784938598.019307:0:24721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326030464 00000100:00100000:2.0:1784938598.019325:0:24721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326030464 00000100:00100000:2.0:1784938598.019415:0:24721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:2.0:1784938598.019424:0:24721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcde919f-d270-4443-90d5-314650605a2d+7:10025:x1871643326030464:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1784938598.019515:0:24721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcde919f-d270-4443-90d5-314650605a2d+7:10025:x1871643326030464:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 94us (2909us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938598.019521:0:24721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00080000:2.0:1784938598.019543:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938598.026407:0:16102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326030720 00000100:00100000:3.0:1784938598.026432:0:16102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326030720 00000100:00100000:1.0:1784938598.026588:0:19399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326030592 00000100:00100000:1.0:1784938598.026594:0:19399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326030592 00000100:00100000:1.0:1784938598.026718:0:19399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:1.0:1784938598.026731:0:19399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fcde919f-d270-4443-90d5-314650605a2d+5:10025:x1871643326030592:12345-192.168.202.4@tcp:400:kworker.0 00000100:00080000:3.0:1784938598.026999:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938598.027131:0:19399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fcde919f-d270-4443-90d5-314650605a2d+5:10025:x1871643326030592:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 401us (10492us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938598.027141:0:19399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:2.0:1784938598.030411:0:16102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:2.0:1784938598.030429:0:16102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcde919f-d270-4443-90d5-314650605a2d+5:10023:x1871643326030720:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1784938598.030589:0:16102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcde919f-d270-4443-90d5-314650605a2d+5:10023:x1871643326030720:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 164us (14102us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938598.030599:0:16102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00080000:3.0:1784938598.031412:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784938598.259894:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938598.771073:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342504448:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938598.772664:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342504576:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938598.775032:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938598.775537:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342504448 00000100:00100000:1.0:1784938598.775551:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342504448 00000100:00100000:1.0:1784938598.775624:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 117 00000100:00100000:1.0:1784938598.775637:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342504448:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938598.776362:0:19601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43319296 pending 0 free 390070272 avail 387973120 00000100:00100000:1.0:1784938598.776450:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342504448:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 813us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938598.776460:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 117 00000100:00100000:3.0:1784938598.779393:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342504448:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938598.779531:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938598.780345:0:16106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342504576 00000100:00100000:0.0:1784938598.780359:0:16106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342504576 00000100:00100000:0.0:1784938598.780434:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 118 00000100:00100000:0.0:1784938598.780445:0:16106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342504576:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938598.780499:0:16106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43319296 pending 0 free 390070272 avail 387973120 00000100:00100000:0.0:1784938598.780596:0:16106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342504576:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 151us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938598.780603:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 118 00000100:00100000:0.0:1784938598.785652:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342504576:192.168.202.104@tcp:13:osp-pre-0-0.0 00010000:00010000:2.0:1784938599.287985:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784938599.369094:0:26899:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-scrub test_4c ldiskfs special test 00010000:00010000:1.0:1784938600.308257:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938601.331549:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784938601.903395:0:26948:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-scrub test 4d: FID in LMA mismatch with object FID won't block create ========================================================== 20:16:40 (1784938600) 00000100:00100000:1.0:1784938602.362715:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342504704:0@lo:400:kworker.0 00000100:00100000:1.0:1784938602.362847:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938602.362911:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342505216:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938602.362988:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784938602.363009:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342504832:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938602.363047:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342505344:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938602.363083:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342505088:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938602.363111:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938602.363116:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342504960:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938602.363424:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938602.363491:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938602.363516:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938602.363535:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938602.363565:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938602.363598:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342504832 00000100:00100000:1.0:1784938602.363607:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342504832 00000100:00100000:1.0:1784938602.363673:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342505344 00000100:00100000:1.0:1784938602.363676:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342505344 00000100:00100000:1.0:1784938602.363691:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342504960 00000100:00100000:1.0:1784938602.363694:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342504960 00000100:00100000:1.0:1784938602.363725:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 38 00000100:00100000:1.0:1784938602.363735:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342504832:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938602.363824:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342504832:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 91us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938602.363849:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 38 00000100:00100000:1.0:1784938602.363870:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 39 00000100:00100000:1.0:1784938602.363876:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342505344:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938602.363900:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342505344:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 24us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938602.363906:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 39 00000100:00100000:1.0:1784938602.363916:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 40 00000100:00100000:1.0:1784938602.363921:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342504960:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938602.363939:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342504960:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 19us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938602.363945:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 40 00000100:00100000:1.0:1784938602.364100:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342504960:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938602.364133:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342504832:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938602.364145:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342505344:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938602.370802:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342504704 00000100:00100000:2.0:1784938602.370826:0:24715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342504704 00000100:00100000:2.0:1784938602.370911:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784938602.370925:0:24715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974740e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12804:x1871643342504704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938602.371060:0:24715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974740e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12804:x1871643342504704:12345-0@lo:400:kworker.0 Request processed in 138us (8213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938602.371070:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784938602.371125:0:19397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342505088 00000100:00100000:2.0:1784938602.371130:0:19397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342505088 00000100:00100000:2.0:1784938602.371169:0:19397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342505216 00000100:00100000:2.0:1784938602.371172:0:19397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342505216 00000100:00100000:2.0:1784938602.371203:0:19397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 93 00000100:00100000:2.0:1784938602.371210:0:19397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342505088:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938602.371271:0:19397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342505088:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 61us (7780us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938602.371278:0:19397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 93 00000100:00100000:2.0:1784938602.371293:0:19397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 94 00000100:00100000:2.0:1784938602.371299:0:19397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342505216:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938602.371323:0:19397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342505216:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 25us (7806us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938602.371347:0:19397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 94 00000100:00100000:2.0:1784938602.371418:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342504704:0@lo:400:kworker.0 00000100:00080000:3.0:1784938602.375816:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938602.375832:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938602.375837:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784938602.376009:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938602.377026:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342505088:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938602.377085:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342505216:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938603.125460:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938603.125589:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938603.125634:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938603.125669:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938603.125728:0:24717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326030848 00000100:00100000:2.0:1784938603.125742:0:24717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326030848 00000100:00100000:2.0:1784938603.125846:0:24717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:2.0:1784938603.125859:0:24717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974740e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10023:x1871643326030848:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1784938603.125955:0:24717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974740e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10023:x1871643326030848:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 99us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938603.125964:0:24717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:2.0:1784938603.131824:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326030976 00000100:00100000:2.0:1784938603.131845:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326030976 00000100:00100000:2.0:1784938603.131953:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:2.0:1784938603.131966:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcde919f-d270-4443-90d5-314650605a2d+7:10025:x1871643326030976:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1784938603.132081:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcde919f-d270-4443-90d5-314650605a2d+7:10025:x1871643326030976:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 116us (6445us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938603.132090:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00080000:3.0:1784938603.133197:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938603.138572:0:16104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326031232 00000100:00100000:1.0:1784938603.138592:0:16104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326031232 00000100:00100000:1.0:1784938603.138731:0:16104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326031104 00000100:00100000:1.0:1784938603.138735:0:16104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326031104 00000100:00080000:3.0:1784938603.138951:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938603.138957:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938603.139104:0:16104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 95 00000100:00100000:1.0:1784938603.139118:0:16104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcde919f-d270-4443-90d5-314650605a2d+5:10023:x1871643326031232:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938603.139250:0:16104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcde919f-d270-4443-90d5-314650605a2d+5:10023:x1871643326031232:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 134us (13804us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938603.139281:0:16104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 95 00000100:00100000:1.0:1784938603.139301:0:16104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 96 00000100:00100000:1.0:1784938603.139308:0:16104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcde919f-d270-4443-90d5-314650605a2d+5:10025:x1871643326031104:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938603.139337:0:16104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcde919f-d270-4443-90d5-314650605a2d+5:10025:x1871643326031104:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (13667us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938603.139353:0:16104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 96 00010000:00010000:0.0:1784938603.387383:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938603.892996:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342505472:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938603.893401:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938603.896488:0:16107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342505472 00000100:00100000:0.0:1784938603.896509:0:16107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342505472 00000100:00100000:0.0:1784938603.896598:0:16107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 119 00000100:00100000:2.0:1784938603.897283:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342505600:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938603.897321:0:16107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342505472:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938603.897375:0:16107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43319296 pending 0 free 390070272 avail 387973120 00000100:00100000:0.0:1784938603.898133:0:16107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342505472:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 1517us (4726us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938603.898147:0:16107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 119 00000100:00100000:1.0:1784938603.898246:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938603.898423:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342505472:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938603.898496:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342505600 00000100:00100000:0.0:1784938603.898504:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342505600 00000100:00100000:0.0:1784938603.898554:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 120 00000100:00100000:0.0:1784938603.898565:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342505600:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938603.899131:0:19601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43319296 pending 0 free 390070272 avail 387973120 00000100:00100000:0.0:1784938603.899206:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342505600:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 640us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938603.899213:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 120 00000100:00100000:0.0:1784938603.899962:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342505600:192.168.202.104@tcp:13:osp-pre-1-0.0 00000001:02000400:0.0:1784938603.918413:0:26997:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-scrub test_4d ldiskfs only test 00010000:00010000:1.0:1784938604.403197:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938605.431293:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784938605.943415:0:27045:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-scrub test 4e: FID reuse can be fixed ========== 20:16:44 (1784938604) 00010000:00010000:3.0:1784938606.453475:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938607.475784:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342505856:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938607.475922:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342506368:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938607.475969:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784938607.475977:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66ce0d8a-9177-486f-adae-cb202cd372dd:12805:1871643342505728:0@lo:400:kworker.0 00000100:00100000:0.0:1784938607.476036:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938607.476080:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342506240:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938607.476126:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342506112:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938607.476156:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938607.476163:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342505984:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938607.476418:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938607.476479:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938607.476503:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938607.476522:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938607.476542:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938607.476568:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342506112 00000100:00100000:0.0:1784938607.476579:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342506112 00000100:00100000:0.0:1784938607.476650:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342506240 00000100:00100000:0.0:1784938607.476679:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342506240 00000100:00100000:0.0:1784938607.476718:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 97 00000100:00100000:0.0:1784938607.476729:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472ff21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342506112:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938607.476816:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472ff21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342506112:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 88us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938607.476825:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 97 00000100:00100000:0.0:1784938607.476848:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 98 00000100:00100000:0.0:1784938607.476856:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472ff21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342506240:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938607.476880:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472ff21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342506240:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938607.476886:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 98 00000100:00080000:0.0:1784938607.476909:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938607.476914:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938607.477050:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342506112:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938607.477085:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342506240:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938607.478208:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342505728 00000100:00100000:2.0:1784938607.478240:0:24715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342505728 00000100:00100000:2.0:1784938607.478307:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784938607.478317:0:24715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12805:x1871643342505728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938607.478407:0:24715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12805:x1871643342505728:12345-0@lo:400:kworker.0 Request processed in 92us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938607.478415:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784938607.478459:0:24721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342506368 00000100:00100000:2.0:1784938607.478463:0:24721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342506368 00000100:00100000:2.0:1784938607.478492:0:24721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342505856 00000100:00100000:2.0:1784938607.478496:0:24721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342505856 00000100:00100000:2.0:1784938607.478520:0:24721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342505984 00000100:00100000:2.0:1784938607.478523:0:24721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342505984 00000100:00100000:2.0:1784938607.478543:0:24721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 42 00000100:00100000:2.0:1784938607.478549:0:24721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472ff20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342506368:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938607.478603:0:24721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472ff20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342506368:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 53us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938607.478610:0:24721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 42 00000100:00100000:2.0:1784938607.478624:0:24721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 43 00000100:00100000:2.0:1784938607.478630:0:24721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472ff20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342505856:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938607.478680:0:24721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472ff20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342505856:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 50us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938607.478686:0:24721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 43 00000100:00100000:2.0:1784938607.478698:0:24721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 44 00000100:00100000:2.0:1784938607.478714:0:24721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472ff22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342505984:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938607.478785:0:24721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472ff22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342505984:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 45us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938607.478804:0:24721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 44 00000100:00080000:2.0:1784938607.478838:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938607.479083:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342505984:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938607.479125:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66ce0d8a-9177-486f-adae-cb202cd372dd:12805:1871643342505728:0@lo:400:kworker.0 00000100:00100000:2.0:1784938607.479141:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342505856:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938607.479154:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342506368:192.168.202.104@tcp:400:kworker.0 00010000:00010000:0.0:1784938607.480093:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784938608.203278:0:27094:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-scrub test_4e ldiskfs only test 00000100:00100000:2.0:1784938608.250029:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938608.250071:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938608.250098:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938608.250302:0:24717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326031360 00000100:00100000:1.0:1784938608.250312:0:24717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326031360 00000100:00100000:1.0:1784938608.250365:0:24717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:1.0:1784938608.250376:0:24717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10023:x1871643326031360:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938608.250457:0:24717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10023:x1871643326031360:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 82us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938608.250464:0:24717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:2.0:1784938608.250531:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938608.251862:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326031616 00000100:00100000:2.0:1784938608.251875:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326031616 00000100:00100000:2.0:1784938608.251945:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326031744 00000100:00100000:2.0:1784938608.251949:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326031744 00000100:00100000:2.0:1784938608.251977:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 925 00000100:00100000:2.0:1784938608.251986:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fcde919f-d270-4443-90d5-314650605a2d+5:10022:x1871643326031616:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:2.0:1784938608.252013:0:19389:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a058ae 00000100:00080000:2.0:1784938608.252023:0:19389:0:(import.c:65:import_set_state_nolock()) ffff97473a696800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784938608.252064:0:19389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967569 00000100:00100000:2.0:1784938608.252328:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fcde919f-d270-4443-90d5-314650605a2d+2:10022:x1871643326031616:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 342us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938608.252336:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 925 00000100:00100000:2.0:1784938608.252352:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 926 00000100:00100000:2.0:1784938608.252368:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fcde919f-d270-4443-90d5-314650605a2d+5:10022:x1871643326031744:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:2.0:1784938608.252381:0:19389:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a058b5 00000100:00080000:2.0:1784938608.252386:0:19389:0:(import.c:65:import_set_state_nolock()) ffff97470898f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784938608.252410:0:19389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967567 00000100:00100000:2.0:1784938608.252547:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fcde919f-d270-4443-90d5-314650605a2d+2:10022:x1871643326031744:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 179us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938608.252554:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 926 00010000:00010000:2.0:1784938608.252643:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938608.252877:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938608.252882:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784938608.254049:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938608.256566:0:24721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326031488 00000100:00100000:1.0:1784938608.256582:0:24721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326031488 00000100:00100000:1.0:1784938608.256674:0:24722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:1.0:1784938608.256701:0:24722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcde919f-d270-4443-90d5-314650605a2d+7:10025:x1871643326031488:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938608.256993:0:24722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcde919f-d270-4443-90d5-314650605a2d+7:10025:x1871643326031488:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 295us (6460us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938608.257014:0:24722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00080000:2.0:1784938608.257955:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784938608.501131:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938609.011074:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342506496:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938609.011375:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938609.011612:0:16107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342506496 00000100:00100000:1.0:1784938609.011620:0:16107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342506496 00000100:00100000:1.0:1784938609.011692:0:16107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 121 00000100:00100000:1.0:1784938609.011701:0:16107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342506496:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938609.011734:0:16107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39911424 pending 0 free 390070272 avail 387973120 00000100:00100000:1.0:1784938609.011792:0:16107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342506496:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 93us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938609.011799:0:16107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 121 00000100:00100000:1.0:1784938609.011905:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342506496:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00080000:2.0:1784938609.011960:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938609.012839:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342506624:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938609.012987:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938609.013011:0:16106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342506624 00000100:00100000:0.0:1784938609.013017:0:16106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342506624 00000100:00100000:0.0:1784938609.013071:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 122 00000100:00100000:0.0:1784938609.013079:0:16106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974741c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342506624:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938609.013106:0:16106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39911424 pending 0 free 390070272 avail 387973120 00000100:00100000:0.0:1784938609.013152:0:16106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974741c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342506624:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 73us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938609.013167:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 122 00000100:00080000:0.0:1784938609.013185:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938609.013274:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342506624:192.168.202.104@tcp:13:osp-pre-1-0.0 00000001:00100000:2.0:1784938609.051975:0:16101:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fcde919f-d270-4443-90d5-314650605a2d 00000020:00000080:2.0:1784938609.051987:0:16101:0:(genops.c:906:class_export_put()) final put ffff97460b35b000/fcde919f-d270-4443-90d5-314650605a2d 00000020:00000080:0.0:1784938609.052057:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff97460b35b000/fcde919f-d270-4443-90d5-314650605a2d for lustre-OST0000 00000020:00000080:0.0:1784938609.052120:0:24411:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97473a696800 for lustre-OST0000 00010000:00010000:0.0:1784938609.523205:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784938609.624582:0:16955:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fcde919f-d270-4443-90d5-314650605a2d 00000020:00000080:3.0:1784938609.624592:0:16955:0:(genops.c:906:class_export_put()) final put ffff97470898a800/fcde919f-d270-4443-90d5-314650605a2d 00000020:00000080:0.0:1784938609.625363:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff97470898a800/fcde919f-d270-4443-90d5-314650605a2d for lustre-OST0001 00000020:00000080:0.0:1784938609.625415:0:24411:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97470898f000 for lustre-OST0001 00000001:02000400:0.0:1784938610.015955:0:27144:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-scrub test 5: OI scrub state machine =========== 20:16:48 (1784938608) 00010000:00010000:2.0:1784938610.548047:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938611.571297:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938612.595027:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938612.595259:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342507136:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938612.595545:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342507008:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938612.596049:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938612.596156:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938612.596265:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342506880:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938612.596822:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342506752:0@lo:400:kworker.0 00000100:00100000:2.0:1784938612.596865:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938612.596903:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974741c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342507264:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938612.596959:0:19397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342507136 00000100:00100000:2.0:1784938612.596967:0:19397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342507136 00000100:00100000:2.0:1784938612.597030:0:19397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 99 00000100:00100000:2.0:1784938612.597040:0:19397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342507136:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938612.597083:0:19397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342507136:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 45us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938612.597090:0:19397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 99 00000100:00100000:2.0:1784938612.597141:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342507008 00000100:00100000:2.0:1784938612.597144:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342507008 00000100:00100000:2.0:1784938612.597173:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 46 00000100:00100000:2.0:1784938612.597179:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12802:x1871643342507008:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938612.597207:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12802:x1871643342507008:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 28us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938612.597213:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 46 00000100:00080000:2.0:1784938612.597228:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938612.597232:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938612.597336:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938612.597423:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938612.597457:0:24722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342506880 00000100:00100000:2.0:1784938612.597461:0:24722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342506880 00000100:00100000:2.0:1784938612.597486:0:24722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 47 00000100:00100000:2.0:1784938612.597491:0:24722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342506880:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938612.597535:0:24722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342506880:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 43us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938612.597541:0:24722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 47 00000100:00100000:2.0:1784938612.597557:0:19392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342507264 00000100:00100000:2.0:1784938612.597560:0:19392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342507264 00000100:00100000:2.0:1784938612.597596:0:19392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 100 00000100:00100000:2.0:1784938612.597603:0:19392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342507264:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938612.597644:0:19392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342507264:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 41us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938612.597649:0:19392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 100 00000100:00080000:2.0:1784938612.597663:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938612.597672:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938612.598157:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342506752 00000100:00100000:3.0:1784938612.598164:0:24715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342506752 00000100:00100000:3.0:1784938612.598200:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784938612.598208:0:24715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12804:x1871643342506752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938612.598261:0:24715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12804:x1871643342506752:12345-0@lo:400:kworker.0 Request processed in 54us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938612.598267:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784938612.598334:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342507008:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938612.598386:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342506752:0@lo:400:kworker.0 00000100:00100000:0.0:1784938612.599293:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342507392:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938612.599396:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342507136:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938612.604168:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938612.604276:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342507264:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938612.604341:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342507392 00000100:00100000:3.0:1784938612.604347:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342507392 00000100:00100000:3.0:1784938612.604432:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 48 00000100:00100000:3.0:1784938612.604442:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342507392:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938612.604601:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974741c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342506880:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938612.614069:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342507392:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 9608us (9896us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938612.614088:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 48 00000100:00100000:3.0:1784938612.624099:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342507392:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938613.368549:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938613.368658:0:24717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326032128 00000100:00100000:1.0:1784938613.368668:0:24717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326032128 00000100:00100000:1.0:1784938613.368735:0:24717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:1.0:1784938613.368745:0:24717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10026:x1871643326032128:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938613.368874:0:24717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10026:x1871643326032128:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 130us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938613.368881:0:24717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 86 00010000:00010000:0.0:1784938613.619659:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938614.130986:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938614.131012:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342507520:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938614.132513:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938614.132660:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938614.132691:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342507648:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938614.133120:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938614.136730:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342507520 00000100:00100000:0.0:1784938614.136746:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342507520 00000100:00100000:0.0:1784938614.136870:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342507648 00000100:00100000:0.0:1784938614.136875:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342507648 00000100:00100000:0.0:1784938614.136901:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 123 00000100:00100000:0.0:1784938614.136912:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342507520:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938614.136974:0:19601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39911424 pending 0 free 390070272 avail 387973120 00000100:00080000:3.0:1784938614.137232:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938614.137237:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938614.137279:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 124 00000100:00100000:3.0:1784938614.137289:0:16106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342507648:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938614.137313:0:16106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39911424 pending 0 free 390070272 avail 387973120 00000100:00100000:0.0:1784938614.145093:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342507520:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 8167us (12571us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938614.145111:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 123 00000100:00100000:3.0:1784938614.145454:0:16106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342507648:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 8164us (12335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938614.145464:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 124 00000100:00100000:1.0:1784938614.159195:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342507648:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938614.159347:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342507520:192.168.202.104@tcp:13:osp-pre-1-0.0 00010000:00010000:1.0:1784938614.644504:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938615.667113:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938616.692126:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938617.714990:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938617.715196:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342507776:0@lo:400:kworker.0 00000100:00100000:3.0:1784938617.715287:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938617.715346:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342508288:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938617.715400:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784938617.715407:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342507904:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938617.715436:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342508416:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938617.715470:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342508160:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938617.715507:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938617.715512:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342508032:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938617.715845:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342507776 00000100:00100000:1.0:1784938617.715853:0:24715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342507776 00000100:00100000:1.0:1784938617.715910:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784938617.715919:0:24715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12804:x1871643342507776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938617.715993:0:24715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12804:x1871643342507776:12345-0@lo:400:kworker.0 Request processed in 76us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938617.716001:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784938617.716068:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938617.716236:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342507776:0@lo:400:kworker.0 00000100:00100000:3.0:1784938617.716424:0:24722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342507904 00000100:00100000:3.0:1784938617.716428:0:24722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342507904 00000100:00100000:3.0:1784938617.716480:0:24722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 49 00000100:00100000:3.0:1784938617.716488:0:24722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342507904:12345-192.168.202.104@tcp:400:kworker.0 00000100:00080000:0.0:1784938617.716545:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938617.716913:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938617.716953:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938617.716976:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938617.716998:0:26820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342508416 00000100:00100000:1.0:1784938617.717003:0:26820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342508416 00000100:00100000:1.0:1784938617.717026:0:26820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342508032 00000100:00100000:1.0:1784938617.717029:0:26820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342508032 00000100:00100000:1.0:1784938617.717050:0:26820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 50 00000100:00100000:1.0:1784938617.717057:0:26820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342508416:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938617.717099:0:26820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342508416:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 41us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938617.717106:0:26820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 50 00000100:00100000:1.0:1784938617.717121:0:26820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 51 00000100:00100000:1.0:1784938617.717128:0:26820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342508032:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938617.717153:0:26820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342508032:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 25us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938617.717171:0:26820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 51 00000100:00100000:0.0:1784938617.717448:0:16104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342508288 00000100:00100000:0.0:1784938617.717453:0:16104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342508288 00000100:00080000:1.0:1784938617.717498:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938617.717502:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938617.719078:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938617.723380:0:24722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342507904:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 6880us (7299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938617.723396:0:24722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 49 00000100:00100000:3.0:1784938617.730092:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342507904:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938617.730117:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342508416:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938617.730182:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342508032:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938617.730888:0:16104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342508160 00000100:00100000:0.0:1784938617.730900:0:16104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342508160 00000100:00100000:0.0:1784938617.730997:0:16104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 101 00000100:00100000:0.0:1784938617.731008:0:16104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342508288:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938617.731104:0:16104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342508288:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 98us (14191us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938617.731113:0:16104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 101 00000100:00100000:0.0:1784938617.731132:0:16104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 102 00000100:00100000:0.0:1784938617.731139:0:16104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342508160:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938617.731167:0:16104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342508160:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 28us (12098us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938617.731174:0:16104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 102 00000100:00100000:0.0:1784938617.731431:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342508160:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938617.731461:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342508288:192.168.202.104@tcp:400:kworker.0 00000100:00080000:3.0:1784938617.731948:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938618.485260:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938618.485391:0:24717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326032256 00000100:00100000:1.0:1784938618.485420:0:24717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326032256 00000100:00100000:1.0:1784938618.485494:0:24717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:1.0:1784938618.485505:0:24717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10023:x1871643326032256:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938618.485628:0:24717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10023:x1871643326032256:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 125us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938618.485637:0:24717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 88 00010000:00010000:1.0:1784938618.741740:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938619.251495:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938619.251521:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342508544:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938619.252898:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938619.253276:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342508672:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938619.253578:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938619.253604:0:16107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342508544 00000100:00100000:0.0:1784938619.253614:0:16107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342508544 00000100:00100000:0.0:1784938619.254499:0:16107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342508672 00000100:00100000:0.0:1784938619.254507:0:16107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342508672 00000100:00100000:0.0:1784938619.254533:0:16107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 125 00000100:00100000:0.0:1784938619.254542:0:16107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342508544:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938619.254590:0:16107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39911424 pending 0 free 390070272 avail 387973120 00000100:00080000:1.0:1784938619.254724:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938619.254729:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938619.255091:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 126 00000100:00100000:3.0:1784938619.255103:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342508672:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938619.255125:0:19601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39911424 pending 0 free 390070272 avail 387973120 00000100:00100000:1.0:1784938619.255532:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342508672:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938619.256093:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342508672:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 69us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938619.256123:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 126 00000100:00100000:0.0:1784938619.256424:0:16107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342508544:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 1880us (3531us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938619.256432:0:16107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 125 00000100:00100000:1.0:1784938619.256833:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342508544:192.168.202.104@tcp:13:osp-pre-0-0.0 00010000:00010000:1.0:1784938619.763703:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938620.786919:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938621.820424:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938622.593949:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938622.594041:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938622.597946:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938622.598115:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326032384 00000100:00100000:3.0:1784938622.598126:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326032384 00000100:00100000:3.0:1784938622.598400:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326032512 00000100:00100000:3.0:1784938622.598405:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326032512 00000100:00100000:2.0:1784938622.598991:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326032640 00000100:00100000:2.0:1784938622.598996:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326032640 00000100:00100000:2.0:1784938622.599030:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:2.0:1784938622.599038:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d34e6509-7f1d-413a-97aa-7aa213f74503+12:10024:x1871643326032384:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938622.599053:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938622.599073:0:17728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974735f29400/0xcd9d312a94a054a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d4faa expref: 12 pid: 24739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938622.599090:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938622.599138:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d34e6509-7f1d-413a-97aa-7aa213f74503+11:10024:x1871643326032384:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 101us (5257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938622.599145:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:2.0:1784938622.599161:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:2.0:1784938622.599166:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10025:x1871643326032512:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938622.599172:0:17728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784938622.599335:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:3.0:1784938622.599343:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d34e6509-7f1d-413a-97aa-7aa213f74503+10:10026:x1871643326032640:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938622.599351:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938622.599360:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974735f28a00/0xcd9d312a94a054b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d4fdb expref: 10 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938622.599371:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938622.599389:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d34e6509-7f1d-413a-97aa-7aa213f74503+9:10026:x1871643326032640:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 48us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938622.599395:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00010000:00010000:2.0:1784938622.599849:0:17728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974742173600/0xcd9d312a94a054a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d4fd4 expref: 8 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938622.599862:0:17728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938622.599958:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d34e6509-7f1d-413a-97aa-7aa213f74503+7:10025:x1871643326032512:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 791us (5916us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938622.599965:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:1.0:1784938622.663625:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938622.663781:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326032896 00000100:00100000:3.0:1784938622.663792:0:24715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326032896 00000100:00100000:3.0:1784938622.663852:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:3.0:1784938622.663861:0:24715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d34e6509-7f1d-413a-97aa-7aa213f74503+7:10022:x1871643326032896:12345-192.168.202.4@tcp:251:umount.0 00000020:00000080:3.0:1784938622.663907:0:24715:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a05494 00000020:00010000:3.0:1784938622.663915:0:24715:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9746020ce800: total 0 00000100:00080000:3.0:1784938622.663919:0:24715:0:(import.c:65:import_set_state_nolock()) ffff9746020cb000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784938622.664002:0:24715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d34e6509-7f1d-413a-97aa-7aa213f74503+3:10022:x1871643326032896:12345-192.168.202.4@tcp:251:umount.0 Request processed in 141us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938622.664009:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 89 00000020:00010000:1.0:1784938622.665311:0:17786:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9746020ce800: total 0 00010000:00010000:1.0:1784938622.665321:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938622.665373:0:17786:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9746020ce800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784938622.665414:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974735f28800/0xcd9d312a94a0549b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d4fa3 expref: 2 pid: 24739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938622.665455:0:17786:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9746020ce800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1784938622.665466:0:17786:0:(genops.c:906:class_export_put()) final put ffff9746020ce800/d34e6509-7f1d-413a-97aa-7aa213f74503 00010000:00010000:1.0:1784938622.665501:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938622.665503:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938622.665505:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784938622.665605:0:12700:0:(genops.c:865:class_export_destroy()) destroying export ffff9746020ce800/d34e6509-7f1d-413a-97aa-7aa213f74503 for MGS 00000020:00000080:3.0:1784938622.665662:0:12700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9746020cb000 for MGS 00000100:00100000:1.0:1784938622.835054:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342509184:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938622.835170:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938622.835178:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342509056:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938622.835488:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938622.835592:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938622.835621:0:19388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342509184 00000100:00100000:1.0:1784938622.835628:0:19388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342509184 00000100:00100000:1.0:1784938622.835683:0:19388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 103 00000100:00100000:1.0:1784938622.835693:0:19388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342509184:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938622.835742:0:19388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342509184:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 50us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938622.835749:0:19388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 103 00000100:00100000:1.0:1784938622.835797:0:26820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342509056 00000100:00100000:1.0:1784938622.835801:0:26820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342509056 00000100:00100000:1.0:1784938622.835830:0:26820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 52 00000100:00100000:1.0:1784938622.835837:0:26820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342509056:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938622.835865:0:26820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342509056:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 29us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938622.835872:0:26820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 52 00000100:00080000:2.0:1784938622.836192:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938622.836198:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938622.836249:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342509056:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938622.836262:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342509184:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938622.836442:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342508928:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938622.836501:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342509440:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938622.836528:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784938622.836536:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66ce0d8a-9177-486f-adae-cb202cd372dd:12805:1871643342508800:0@lo:400:kworker.0 00000100:00100000:3.0:1784938622.836578:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938622.836606:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342509312:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938622.836641:0:24717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342508800 00000100:00100000:3.0:1784938622.836645:0:24717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342508800 00000100:00100000:3.0:1784938622.836673:0:24717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784938622.836680:0:24717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12805:x1871643342508800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938622.836717:0:24717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12805:x1871643342508800:12345-0@lo:400:kworker.0 Request processed in 38us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938622.836723:0:24717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784938622.836775:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66ce0d8a-9177-486f-adae-cb202cd372dd:12805:1871643342508800:0@lo:400:kworker.0 00010000:00010000:3.0:1784938622.836832:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938622.837838:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938622.837869:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938622.837908:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938622.838531:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342508928 00000100:00100000:0.0:1784938622.838549:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342508928 00000100:00100000:0.0:1784938622.838611:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342509440 00000100:00100000:0.0:1784938622.838615:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342509440 00000100:00100000:0.0:1784938622.838642:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 53 00000100:00100000:0.0:1784938622.838650:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342508928:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938622.838707:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342508928:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 58us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938622.838714:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 53 00000100:00100000:0.0:1784938622.838729:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 54 00000100:00100000:0.0:1784938622.838735:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342509440:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938622.838794:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342509440:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 59us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938622.838801:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 54 00000100:00100000:0.0:1784938622.838825:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342509312 00000100:00100000:0.0:1784938622.838842:0:19396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342509312 00000100:00100000:0.0:1784938622.838875:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 104 00000100:00100000:0.0:1784938622.838894:0:19396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342509312:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938622.838923:0:19396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342509312:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 42us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938622.838929:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 104 00000100:00100000:3.0:1784938622.839568:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342509312:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938622.839583:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342508928:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938622.839593:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342509440:192.168.202.104@tcp:400:kworker.0 00000100:00080000:2.0:1784938622.839701:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938622.839706:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784938623.863704:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938624.370959:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784938624.370985:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342509568:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938624.371112:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342509696:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938624.381667:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938624.381825:0:16106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342509568 00000100:00100000:3.0:1784938624.381837:0:16106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342509568 00000100:00100000:3.0:1784938624.381933:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 127 00000100:00100000:3.0:1784938624.381945:0:16106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342509568:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938624.381991:0:16106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39911424 pending 0 free 390070272 avail 387973120 00000100:00100000:3.0:1784938624.382067:0:16106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342509568:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 124us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938624.382075:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 127 00000100:00100000:2.0:1784938624.382596:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00080000:2.0:1784938624.382650:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938624.382698:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342509568:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938624.382801:0:16107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342509696 00000100:00100000:3.0:1784938624.382806:0:16107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342509696 00000100:00100000:3.0:1784938624.382840:0:16107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 128 00000100:00100000:3.0:1784938624.382848:0:16107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342509696:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938624.382872:0:16107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 39911424 pending 0 free 390070272 avail 387973120 00000100:00100000:3.0:1784938624.382913:0:16107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342509696:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 65us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938624.382920:0:16107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 128 00000100:00080000:2.0:1784938624.383581:0:15296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938624.383616:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342509696:192.168.202.104@tcp:13:osp-pre-1-0.0 00010000:00010000:0.0:1784938624.901914:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784938625.440430:0:27268:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1784938625.462788:0:27268:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1784938625.462882:0:27268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c40600/0xcd9d312a94a0528e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a05295 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.462895:0:27268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c40600/0xcd9d312a94a0528e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a05295 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.462903:0:27268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c40600/0xcd9d312a94a0528e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a05295 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.462909:0:27268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974609c40600/0xcd9d312a94a0528e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a05295 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.462937:0:27268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784938625.462943:0:27268:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1784938625.462981:0:27268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784938625.462985:0:27268:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784938625.462990:0:27268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784938625.463013:0:27268:0:(import.c:65:import_set_state_nolock()) ffff974718c79000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1784938625.463099:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938625.463106:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974609c40600/0xcd9d312a94a0528e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a05295 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938625.463113:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c40600 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:2.0:1784938625.463117:0:17786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974609c40600/0xcd9d312a94a0528e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a05295 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938625.463141:0:17786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609c40600/0xcd9d312a94a0528e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a05295 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938625.463149:0:17786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609c40600/0xcd9d312a94a0528e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a05295 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938625.463155:0:17786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938625.463157:0:17786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784938625.463160:0:17786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784938625.463198:0:17786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974609c40600/0xcd9d312a94a0528e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a05295 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938625.463206:0:17786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938625.463234:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974609c40600/0xcd9d312a94a0528e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a05295 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938625.463242:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609c40600/0xcd9d312a94a0528e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a05295 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938625.463253:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938625.463255:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938625.463257:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938625.463605:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66ce0d8a-9177-486f-adae-cb202cd372dd:12803:1871643342509952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938625.463673:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938625.463895:0:15287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342509952 00000100:00100000:2.0:1784938625.463903:0:15287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342509952 00000100:00100000:2.0:1784938625.463962:0:15287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784938625.463971:0:15287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12803:x1871643342509952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938625.463986:0:15287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938625.464001:0:15287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609c04800/0xcd9d312a94a05295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a0528e expref: 19 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938625.464026:0:15287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938625.464076:0:15287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66ce0d8a-9177-486f-adae-cb202cd372dd+18:12803:x1871643342509952:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938625.464084:0:15287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784938625.464122:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66ce0d8a-9177-486f-adae-cb202cd372dd:12803:1871643342509952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938625.464941:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342509824:192.168.202.104@tcp:39:umount.0 00000100:00100000:2.0:1784938625.465213:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938625.465238:0:24723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342509824 00000100:00100000:2.0:1784938625.465244:0:24723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342509824 00000100:00100000:2.0:1784938625.465281:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 123 00000100:00100000:2.0:1784938625.465290:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12801:x1871643342509824:12345-192.168.202.104@tcp:39:umount.0 00000020:00000080:2.0:1784938625.465314:0:24723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a0548d 00000100:00080000:2.0:1784938625.465328:0:24723:0:(import.c:65:import_set_state_nolock()) ffff974702c03800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1784938625.465402:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:12801:x1871643342509824:12345-192.168.202.104@tcp:39:umount.0 Request processed in 112us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938625.465409:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 123 00000020:00000080:2.0:1784938625.465418:0:24723:0:(genops.c:906:class_export_put()) final put ffff9747102ac800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784938625.465907:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9747102ac800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784938625.465987:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974702c03800 for lustre-MDT0000 00010000:00010000:3.0:1784938625.466331:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938625.466364:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974718c79000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784938625.466376:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342509824:192.168.202.104@tcp:39:umount.0 00000100:00080000:0.0:1784938625.466596:0:27268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784938625.466600:0:27268:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784938625.466605:0:27268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784938625.467708:0:27268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b6400/0xcd9d312a94a051e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a051ed expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.467725:0:27268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b6400/0xcd9d312a94a051e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a051ed expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.467733:0:27268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b6400/0xcd9d312a94a051e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a051ed expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.467740:0:27268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff97460a1b6400/0xcd9d312a94a051e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a051ed expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.467785:0:27268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938625.467792:0:27268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b6c00/0xcd9d312a94a052b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a052b8 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.467800:0:27268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b6c00/0xcd9d312a94a052b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a052b8 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.467807:0:27268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b6c00/0xcd9d312a94a052b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a052b8 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.467814:0:27268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff97460a1b6c00/0xcd9d312a94a052b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a052b8 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.467831:0:27268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784938625.467848:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938625.467868:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97460a1b6400/0xcd9d312a94a051e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a051ed expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.467876:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460a1b6400 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:0.0:1784938625.467880:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97460a1b6400/0xcd9d312a94a051e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a051ed expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.467890:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460a1b6400/0xcd9d312a94a051e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a051ed expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938625.467898:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460a1b6400/0xcd9d312a94a051e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a051ed expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938625.467905:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784938625.467908:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1784938625.467937:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97460a1b6400/0xcd9d312a94a051e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a051ed expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.467945:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938625.467974:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97460a1b6400/0xcd9d312a94a051e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a051ed expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.467982:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460a1b6400/0xcd9d312a94a051e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a051ed expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.467995:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938625.467999:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97460a1b6c00/0xcd9d312a94a052b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a052b8 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468005:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460a1b6c00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:0.0:1784938625.468008:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97460a1b6c00/0xcd9d312a94a052b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a052b8 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468022:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460a1b6c00/0xcd9d312a94a052b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a052b8 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938625.468029:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460a1b6c00/0xcd9d312a94a052b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a052b8 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938625.468035:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1784938625.468037:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1784938625.468040:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1784938625.468053:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97460a1b6c00/0xcd9d312a94a052b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a052b8 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468061:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938625.468068:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97460a1b6c00/0xcd9d312a94a052b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a052b8 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468075:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460a1b6c00/0xcd9d312a94a052b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a052b8 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468088:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938625.468090:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938625.468092:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938625.468109:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342510080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938625.468186:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938625.468234:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938625.468240:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342510208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938625.468267:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938625.468382:0:27268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c05a00/0xcd9d312a94a05280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a05287 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468397:0:27268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c05a00/0xcd9d312a94a05280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a05287 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468404:0:27268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c05a00/0xcd9d312a94a05280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a05287 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468411:0:27268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974609c05a00/0xcd9d312a94a05280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a05287 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468423:0:27268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938625.468428:0:27268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b6600/0xcd9d312a94a051d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a051df expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468436:0:27268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b6600/0xcd9d312a94a051d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a051df expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468443:0:27268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b6600/0xcd9d312a94a051d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a051df expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468451:0:27268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff97460a1b6600/0xcd9d312a94a051d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a051df expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468463:0:27268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1784938625.468467:0:27268:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1784938625.468471:0:27268:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1784938625.468525:0:27268:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1784938625.468529:0:27268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1784938625.468535:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938625.468539:0:27268:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/7 00000020:00080000:0.0:1784938625.468552:0:27268:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9746020c9000 fcde919f-d270-4443-90d5-314650605a2d 192.168.202.4@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 21474836571 stale:0 00000020:00080000:0.0:1784938625.468558:0:27268:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9747102ae000 lustre-MDT0000-lwp-OST0000_UUID 192.168.202.104@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784938625.468562:0:27268:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9747102ae800 lustre-MDT0000-lwp-OST0001_UUID 192.168.202.104@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784938625.468566:0:27268:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff974609e899c0) has exports, disconnecting them 00000020:00080000:0.0:1784938625.468570:0:27268:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.4@tcp (ffff9746020c9000), last request at 1784938608 00000020:00000080:0.0:1784938625.468582:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a054b7 00000020:00010000:0.0:1784938625.468592:0:27268:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9746020c9000: total 0 00000100:00080000:0.0:1784938625.468596:0:27268:0:(import.c:65:import_set_state_nolock()) ffff974729ec8000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1784938625.468642:0:15289:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9746020c9000: total 0 00010000:00010000:0.0:1784938625.468670:0:15289:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9746020c9000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1784938625.468705:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974607a4b000/0xcd9d312a94a0553c lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5028 expref: 6 pid: 24721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468726:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c40e00/0xcd9d312a94a054d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5005 expref: 5 pid: 24721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938625.468738:0:15289:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9746020c9000, canceled 2 locks, left on hash table 0. 00000100:00100000:1.0:1784938625.469885:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342510080 00000100:00100000:1.0:1784938625.469899:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342510080 00000100:00100000:1.0:1784938625.469958:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342510208 00000100:00100000:1.0:1784938625.469961:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342510208 00000100:00100000:1.0:1784938625.469987:0:19391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784938625.469995:0:19391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66ce0d8a-9177-486f-adae-cb202cd372dd+19:12804:x1871643342510080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938625.470009:0:19391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938625.470022:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460a1b7000/0xcd9d312a94a051ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a051e6 expref: 19 pid: 24739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938625.470037:0:19391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938625.470346:0:19391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66ce0d8a-9177-486f-adae-cb202cd372dd+18:12804:x1871643342510080:12345-0@lo:103:ldlm_bl.0 Request processed in 350us (2159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938625.470354:0:19391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784938625.470371:0:19391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784938625.470378:0:19391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974710d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66ce0d8a-9177-486f-adae-cb202cd372dd+17:12804:x1871643342510208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938625.470386:0:19391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938625.470396:0:19391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609c40000/0xcd9d312a94a052b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a052b1 expref: 17 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938625.470409:0:19391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938625.470431:0:19391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974710d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66ce0d8a-9177-486f-adae-cb202cd372dd+16:12804:x1871643342510208:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (2163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938625.470437:0:19391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784938625.470698:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342510208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938625.470724:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342510080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938625.471186:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938625.471194:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974609c05a00/0xcd9d312a94a05280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a05287 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938625.471203:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c05a00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938625.471207:0:18251:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974609c05a00/0xcd9d312a94a05280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a05287 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938625.471216:0:18251:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609c05a00/0xcd9d312a94a05280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a05287 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938625.471234:0:18251:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609c05a00/0xcd9d312a94a05280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a05287 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938625.471239:0:18251:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784938625.471242:0:18251:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784938625.471245:0:18251:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784938625.471268:0:18251:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974609c05a00/0xcd9d312a94a05280 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a05287 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938625.471275:0:18251:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938625.471296:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974609c05a00/0xcd9d312a94a05280 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a05287 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938625.471303:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609c05a00/0xcd9d312a94a05280 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a05287 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938625.471313:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938625.471316:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97460a1b6600/0xcd9d312a94a051d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a051df expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938625.471322:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460a1b6600 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938625.471324:0:18251:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97460a1b6600/0xcd9d312a94a051d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a051df expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938625.471331:0:18251:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460a1b6600/0xcd9d312a94a051d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a051df expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938625.471337:0:18251:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460a1b6600/0xcd9d312a94a051d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a051df expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938625.471352:0:18251:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938625.471355:0:18251:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784938625.471357:0:18251:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784938625.471371:0:18251:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97460a1b6600/0xcd9d312a94a051d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a051df expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938625.471377:0:18251:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938625.471383:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97460a1b6600/0xcd9d312a94a051d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a051df expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938625.471389:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460a1b6600/0xcd9d312a94a051d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a051df expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938625.471402:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938625.471404:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938625.471405:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938625.471480:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66ce0d8a-9177-486f-adae-cb202cd372dd:12802:1871643342510336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938625.471674:0:12802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938625.471713:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938625.471719:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66ce0d8a-9177-486f-adae-cb202cd372dd:12802:1871643342510464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938625.471741:0:12802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938625.471789:0:15286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342510336 00000100:00100000:3.0:1784938625.471794:0:15286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342510336 00000100:00100000:3.0:1784938625.471829:0:15286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342510464 00000100:00100000:3.0:1784938625.471831:0:15286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342510464 00000100:00100000:3.0:1784938625.471850:0:15286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784938625.471857:0:15286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66ce0d8a-9177-486f-adae-cb202cd372dd+17:12802:x1871643342510336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938625.471867:0:15286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938625.471884:0:15286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609c05600/0xcd9d312a94a05287 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a05280 expref: 17 pid: 24739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938625.471893:0:15286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938625.471923:0:15286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66ce0d8a-9177-486f-adae-cb202cd372dd+16:12802:x1871643342510336:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938625.471930:0:15286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784938625.471945:0:15286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784938625.471951:0:15286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66ce0d8a-9177-486f-adae-cb202cd372dd+15:12802:x1871643342510464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938625.471958:0:15286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938625.471965:0:15286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609c04c00/0xcd9d312a94a051df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a051d8 expref: 15 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938625.471976:0:15286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938625.471994:0:15286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66ce0d8a-9177-486f-adae-cb202cd372dd+14:12802:x1871643342510464:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938625.472000:0:15286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784938625.472026:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66ce0d8a-9177-486f-adae-cb202cd372dd:12802:1871643342510464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938625.472033:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66ce0d8a-9177-486f-adae-cb202cd372dd:12802:1871643342510336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938625.472620:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938625.472631:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1784938625.472831:0:27268:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836571 00000020:00080000:2.0:1784938625.473304:0:27268:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff9746020c9000): rc 0 00000020:00080000:2.0:1784938625.473310:0:27268:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.104@tcp (ffff9747102ae000), last request at 1784938622 00000020:00000080:2.0:1784938625.473316:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a05486 00000100:00080000:2.0:1784938625.473324:0:27268:0:(import.c:65:import_set_state_nolock()) ffff9747102a8000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784938625.473351:0:27268:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.104@tcp (ffff9747102ae000): rc 0 00000020:00000080:2.0:1784938625.473361:0:27268:0:(genops.c:906:class_export_put()) final put ffff9747102ae000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1784938625.473374:0:27268:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.104@tcp (ffff9747102ae800), last request at 1784938622 00000020:00000080:2.0:1784938625.473378:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a0547f 00000100:00080000:2.0:1784938625.473383:0:27268:0:(import.c:65:import_set_state_nolock()) ffff9747102aa000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784938625.473398:0:12700:0:(genops.c:865:class_export_destroy()) destroying export ffff9747102ae000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784938625.473445:0:12700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9747102a8000 for lustre-MDT0000 00010000:00010000:2.0:1784938625.473456:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784938625.473463:0:27268:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.104@tcp (ffff9747102ae800): rc 0 00000020:00000080:2.0:1784938625.473465:0:27268:0:(genops.c:906:class_export_put()) final put ffff9747102ae800/lustre-MDT0000-lwp-OST0001_UUID 00000004:00000080:2.0:1784938625.473474:0:27268:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa2eecaf27ae0 00000020:00000080:2.0:1784938625.473485:0:12700:0:(genops.c:865:class_export_destroy()) destroying export ffff9747102ae800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1784938625.473841:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784938625.474170:0:12700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9747102aa000 for lustre-MDT0000 00000100:00080000:2.0:1784938625.474196:0:27268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784938625.474200:0:27268:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967569 gen 3 00000004:00080000:2.0:1784938625.474212:0:27268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784938625.474285:0:27268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784938625.474305:0:27268:0:(import.c:65:import_set_state_nolock()) ffff974718b19800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784938625.474325:0:27268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784938625.474328:0:27268:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967567 gen 3 00000004:00080000:2.0:1784938625.474338:0:27268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784938625.474401:0:27268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784938625.474409:0:27268:0:(import.c:65:import_set_state_nolock()) ffff9747101c0000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1784938625.474439:0:27268:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff974609e899c0) has no exports 00000100:00100000:2.0:1784938625.475275:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342510592:192.168.202.104@tcp:9:umount.0 00000100:00100000:2.0:1784938625.475358:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342510720:192.168.202.104@tcp:9:umount.0 00000100:00100000:3.0:1784938625.476293:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938625.476320:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938625.476346:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342510592 00000100:00100000:3.0:1784938625.476353:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342510592 00000100:00100000:3.0:1784938625.476392:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342510720 00000100:00100000:3.0:1784938625.476395:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342510720 00000100:00100000:3.0:1784938625.476417:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 927 00000100:00100000:3.0:1784938625.476426:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:12801:x1871643342510592:12345-192.168.202.104@tcp:9:umount.0 00000020:00000080:3.0:1784938625.476468:0:19389:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a0525d 00000100:00080000:3.0:1784938625.476477:0:19389:0:(import.c:65:import_set_state_nolock()) ffff97470622e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784938625.477957:0:27268:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff974609e899c0) has no exports 00000001:00000004:3.0:1784938625.478820:0:19389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967569 00000100:00100000:3.0:1784938625.480868:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:12801:x1871643342510592:12345-192.168.202.104@tcp:9:umount.0 Request processed in 4432us (4568us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938625.480883:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 927 00000100:00100000:3.0:1784938625.480915:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 928 00000100:00100000:3.0:1784938625.480927:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:12801:x1871643342510720:12345-192.168.202.104@tcp:9:umount.0 00000020:00000080:3.0:1784938625.480953:0:19389:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a0526b 00000100:00080000:3.0:1784938625.480964:0:19389:0:(import.c:65:import_set_state_nolock()) ffff974718ae5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784938625.480994:0:19389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967567 00000100:00100000:3.0:1784938625.483123:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:12801:x1871643342510720:12345-192.168.202.104@tcp:9:umount.0 Request processed in 2190us (6792us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938625.483138:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 928 00010000:00010000:3.0:1784938625.483169:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938625.483360:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938625.483402:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974718b19800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784938625.483417:0:12801:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784938625.483420:0:12801:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938625.483424:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342510592:192.168.202.104@tcp:9:umount.0 00000100:00080000:3.0:1784938625.483437:0:12801:0:(import.c:65:import_set_state_nolock()) ffff9747101c0000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784938625.483446:0:12801:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784938625.483448:0:12801:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938625.483451:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342510720:192.168.202.104@tcp:9:umount.0 00010000:00010000:0.0:1784938625.550094:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938625.550102:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938625.550105:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784938625.577457:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a05233 00000020:00000080:2.0:1784938625.577488:0:27268:0:(genops.c:906:class_export_put()) final put ffff97471d9f6000/lustre-QMT0000_UUID 00000020:01000000:2.0:1784938625.577732:0:27268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1784938625.577832:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97471d9f6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1784938625.577930:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938625.577940:0:27268:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784938625.577944:0:27268:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff974736683380) has no exports 00000020:00000080:3.0:1784938625.579211:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a0522c 00000020:00000080:3.0:1784938625.579221:0:27268:0:(genops.c:906:class_export_put()) final put ffff974601088800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784938625.579289:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938625.579300:0:27268:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784938625.579304:0:27268:0:(genops.c:906:class_export_put()) final put ffff9747101c0800/lustre-QMT0000_UUID 00000020:00000080:3.0:1784938625.579307:0:27268:0:(genops.c:865:class_export_destroy()) destroying export ffff9747101c0800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1784938625.579317:0:27268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1784938625.579535:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974601088800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1784938625.907077:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938626.931948:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938627.955136:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938627.955405:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342510848:0@lo:400:kworker.0 00000100:00100000:1.0:1784938627.955484:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938627.955561:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938627.955571:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342510976:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938627.955673:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938627.955683:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342511104:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938627.955869:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938627.955947:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938627.956064:0:24715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342510848 00000100:00100000:2.0:1784938627.956071:0:24715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342510848 00000100:00100000:2.0:1784938627.956114:0:24715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784938627.956123:0:24715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66ce0d8a-9177-486f-adae-cb202cd372dd+14:12804:x1871643342510848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938627.956184:0:24722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342510976 00000100:00100000:3.0:1784938627.956188:0:24722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342510976 00000100:00100000:3.0:1784938627.956212:0:24722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342511104 00000100:00100000:3.0:1784938627.956214:0:24722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342511104 00000100:00100000:3.0:1784938627.956232:0:24722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 124 00000100:00100000:3.0:1784938627.956237:0:24722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12804:x1871643342510976:12345-192.168.202.104@tcp:400:kworker.0 00000020:00080000:3.0:1784938627.956244:0:24722:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.104@tcp 00000100:00100000:0.0:1784938627.956378:0:24723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 125 00000100:00100000:0.0:1784938627.956385:0:24723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:12803:x1871643342511104:12345-192.168.202.104@tcp:400:kworker.0 00000020:00080000:0.0:1784938627.956391:0:24723:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.104@tcp 00000100:00100000:2.0:1784938627.967462:0:24715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66ce0d8a-9177-486f-adae-cb202cd372dd+14:12804:x1871643342510848:12345-0@lo:400:kworker.0 Request processed in 11328us (11966us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938627.967478:0:24715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784938627.967657:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342510848:0@lo:400:kworker.0 00000100:00100000:3.0:1784938627.969338:0:24722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12804:x1871643342510976:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 13089us (13459us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784938627.969351:0:24722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 124 00000100:00100000:0.0:1784938627.976048:0:24723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:12803:x1871643342511104:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 19647us (20085us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784938627.976064:0:24723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 125 00000100:00080000:2.0:1784938627.983921:0:12803:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@192.168.202.104@tcp abruptly disconnected: reconnecting 00000100:00080000:2.0:1784938627.983930:0:12803:0:(import.c:65:import_set_state_nolock()) ffff974601dd1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784938627.983935:0:12803:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 192.168.202.104@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784938627.986622:0:12804:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@192.168.202.104@tcp abruptly disconnected: reconnecting 00000100:00080000:0.0:1784938627.986630:0:12804:0:(import.c:65:import_set_state_nolock()) ffff974603c34000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784938627.986636:0:12804:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 192.168.202.104@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784938627.986643:0:12804:0:(import.c:65:import_set_state_nolock()) ffff974603c34000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938627.986648:0:12804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.202.104@tcp last attempt 701 00000100:00080000:0.0:1784938627.986663:0:12804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff974603c34000 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:0.0:1784938627.986702:0:12804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97473a635c00 x1871643342511232/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938627.986743:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342510976:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938627.986868:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342511232:192.168.202.104@tcp:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784938627.987159:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938627.987231:0:24721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342511232 00000100:00100000:1.0:1784938627.987238:0:24721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342511232 00000100:00100000:1.0:1784938627.987283:0:24721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 126 00000100:00100000:1.0:1784938627.987291:0:24721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:12801:x1871643342511232:12345-192.168.202.104@tcp:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1784938627.987309:0:24721:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.202.104@tcp (stopping) 00000100:00080000:2.0:1784938628.010350:0:12803:0:(import.c:65:import_set_state_nolock()) ffff974601dd1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938628.010366:0:12803:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.202.104@tcp last attempt 701 00000100:00080000:2.0:1784938628.010381:0:12803:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff974601dd1800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:2.0:1784938628.010465:0:12803:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9747358fb480 x1871643342511360/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938628.010520:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342511104:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938628.010627:0:24721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:12801:x1871643342511232:12345-192.168.202.104@tcp:38:ptlrpcd_00_02.0 Request processed in 23333us (23467us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784938628.010638:0:24721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 126 00000100:00100000:3.0:1784938628.010770:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342511360:192.168.202.104@tcp:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1784938628.011081:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938628.011116:0:24722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342511360 00000100:00100000:3.0:1784938628.011124:0:24722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342511360 00000100:00100000:3.0:1784938628.011182:0:24722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 127 00000100:00100000:3.0:1784938628.011188:0:24722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12801:x1871643342511360:12345-192.168.202.104@tcp:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1784938628.011206:0:24722:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.202.104@tcp (stopping) 00000100:00080000:1.0:1784938628.011216:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974603c34000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938628.011221:0:12801:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.104@tcp failed (-19) 00000100:00100000:1.0:1784938628.011225:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342511232:192.168.202.104@tcp:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784938628.011233:0:24722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12801:x1871643342511360:12345-192.168.202.104@tcp:38:ptlrpcd_00_01.0 Request processed in 45us (154us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784938628.011239:0:24722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 127 00000100:00080000:1.0:1784938628.011433:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974601dd1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938628.011438:0:12801:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.104@tcp failed (-19) 00000100:00100000:1.0:1784938628.011442:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342511360:192.168.202.104@tcp:38:ptlrpcd_00_01.0 00000001:00100000:1.0:1784938628.589237:0:24729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fcde919f-d270-4443-90d5-314650605a2d 00000020:00000080:1.0:1784938628.589248:0:24729:0:(genops.c:906:class_export_put()) final put ffff9746020c9000/fcde919f-d270-4443-90d5-314650605a2d 00000020:00000080:1.0:1784938628.589275:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9746020c9000/fcde919f-d270-4443-90d5-314650605a2d for lustre-MDT0000 00000020:00000080:1.0:1784938628.589342:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974729ec8000 for lustre-MDT0000 00010000:00010000:0.0:1784938628.980096:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784938629.584907:0:16101:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784938629.584917:0:16101:0:(genops.c:906:class_export_put()) final put ffff974706229000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938629.585122:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974706229000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1784938629.585176:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97470622e800 for lustre-OST0000 00010000:00010000:3.0:1784938630.003979:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784938630.061706:0:16955:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938630.061716:0:16955:0:(genops.c:906:class_export_put()) final put ffff974718ae2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784938630.061836:0:12700:0:(genops.c:865:class_export_destroy()) destroying export ffff974718ae2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784938630.061890:0:12700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974718ae5800 for lustre-OST0001 00010000:00010000:3.0:1784938631.027066:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1784938631.668931:0:27268:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97473a834420 - data ffff97471e36f1b0/ffff974710d9a800 00000020:01000000:3.0:1784938631.669075:0:27268:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97460a20a7e0 - data ffff97472c554af8/ffff974705194000 00000001:00000004:0.0:1784938631.675545:0:27268:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836571 00000100:00080000:3.0:1784938631.794023:0:27268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784938631.794032:0:27268:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967569 gen 4 00000004:00080000:3.0:1784938631.794059:0:27268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938631.794063:0:27268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784938631.794666:0:24744:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784938631.794672:0:24744:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 40 count 1 00000040:00080000:0.0:1784938631.794683:0:24744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 5 count 2 00000100:00080000:3.0:1784938631.796585:0:27268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784938631.796592:0:27268:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967567 gen 4 00000004:00080000:3.0:1784938631.796617:0:27268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938631.796620:0:27268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784938631.796997:0:24746:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784938631.797002:0:24746:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x16:0x0] index 41 count 1 00000040:00080000:0.0:1784938631.797012:0:24746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 5 count 2 00000020:00000080:3.0:1784938631.874158:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a051fb 00000020:00000080:3.0:1784938631.874173:0:27268:0:(genops.c:906:class_export_put()) final put ffff97473a63d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784938631.875243:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a05210 00000020:00000080:3.0:1784938631.875253:0:27268:0:(genops.c:906:class_export_put()) final put ffff974609cee800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784938631.875260:0:27268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1784938631.875265:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938631.875275:0:27268:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784938631.875279:0:27268:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff974609e8b380) has no exports 00000004:01000000:3.0:1784938631.875431:0:27268:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1784938631.875440:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a05264 00000020:00000080:3.0:1784938631.875460:0:27268:0:(genops.c:906:class_export_put()) final put ffff974718b18000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784938631.875474:0:27268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784938631.875478:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938631.875484:0:27268:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784938631.875487:0:27268:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9747366819c0) has no exports 00000020:00000080:3.0:1784938631.875493:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a05256 00000020:00000080:3.0:1784938631.875496:0:27268:0:(genops.c:906:class_export_put()) final put ffff974735214000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784938631.875629:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97473a63d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784938631.875640:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974609cee800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1784938631.875644:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974718b18000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784938631.875648:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974735214000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1784938631.879709:0:27268:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784938631.879717:0:27268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784938631.879722:0:27268:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967567 gen 5 00000004:00080000:3.0:1784938631.879729:0:27268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938631.879732:0:27268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784938631.879906:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938631.879918:0:27268:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938631.879926:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a05248 00000020:00000080:3.0:1784938631.879935:0:27268:0:(genops.c:906:class_export_put()) final put ffff974718b19000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784938631.889732:0:27268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784938631.889766:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938631.889779:0:27268:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784938631.889785:0:27268:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff974708a43380) has no exports 00000020:00000080:3.0:1784938631.889794:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a05241 00000020:00000080:3.0:1784938631.889803:0:27268:0:(genops.c:906:class_export_put()) final put ffff974718b1d800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1784938631.890228:0:27268:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784938631.890234:0:27268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784938631.890239:0:27268:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967569 gen 5 00000004:00080000:3.0:1784938631.890245:0:27268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938631.890248:0:27268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784938631.890283:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938631.890289:0:27268:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938631.890320:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938631.890324:0:27268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938631.890327:0:27268:0:(genops.c:906:class_export_put()) final put ffff97460912b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938631.890342:0:27268:0:(genops.c:865:class_export_destroy()) destroying export ffff97460912b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784938631.890348:0:27268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938631.890525:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a05217 00000020:00000080:3.0:1784938631.890813:0:27268:0:(genops.c:906:class_export_put()) final put ffff974609ceb000/lustre-MDD0000_UUID 00000020:01000000:3.0:1784938631.890856:0:27268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1784938631.890862:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938631.890866:0:27268:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784938631.890869:0:27268:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff974609e8cd40) has no exports 00000020:00000080:3.0:1784938631.890890:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938631.890894:0:27268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1784938631.890899:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a0521e 00000020:00000080:3.0:1784938631.890902:0:27268:0:(genops.c:906:class_export_put()) final put ffff97460912f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784938631.890959:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9747101c0000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784938631.890967:0:36:0:(genops.c:906:class_export_put()) final put ffff974718b1b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784938631.890977:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974718b1b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1784938631.890982:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000004:3.0:1784938631.896172:0:27268:0:(tgt_mount.c:187:server_put_mount()) put mount ffff974729ecc000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1784938631.896182:0:27268:0:(obd_mount.c:706:lustre_put_lsi()) put ffff974729ecc000 3 00000020:01000004:3.0:1784938631.896185:0:27268:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff974729ecc000 from lustre-MDT0000 00000020:00000080:3.0:1784938631.896219:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938631.896229:0:27268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1784938631.896234:0:27268:0:(genops.c:906:class_export_put()) final put ffff97473a63c000/lustre-MDT0000_UUID 00000020:00000080:3.0:1784938631.896239:0:27268:0:(genops.c:865:class_export_destroy()) destroying export ffff97473a63c000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1784938631.896255:0:27268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1784938631.896318:0:27268:0:(obd_mount.c:574:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1784938631.896323:0:27268:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1784938631.896327:0:27268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1784938631.896332:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938631.896336:0:27268:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784938631.896343:0:27268:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97460912c800 66ce0d8a-9177-486f-adae-cb202cd372dd 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784938631.896350:0:27268:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff974729ea99c0) has exports, disconnecting them 00000020:00080000:3.0:1784938631.896354:0:27268:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97460912c800), last request at 1784938541 00000020:00000080:3.0:1784938631.896369:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a051bc 00000020:00010000:3.0:1784938631.896376:0:27268:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97460912c800: total 4 00000100:00080000:3.0:1784938631.896381:0:27268:0:(import.c:65:import_set_state_nolock()) ffff97460912b800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784938631.896395:0:27268:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97460912c800): rc 0 00000020:00080000:3.0:1784938631.896411:0:27268:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff974729ea99c0) has no exports 00000020:00010000:3.0:1784938631.896420:0:15288:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97460912c800: total 4 00010000:00010000:3.0:1784938631.896441:0:15288:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97460912c800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1784938631.896484:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460a1b7200/0xcd9d312a94a052d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a052cd expref: 9 pid: 24716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938631.896502:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460a1b7600/0xcd9d312a94a052c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a052bf expref: 8 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938631.896514:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609c04400/0xcd9d312a94a052e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a052db expref: 7 pid: 24717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938631.896525:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460a1b7e00/0xcd9d312a94a053de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a053d7 expref: 6 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938631.896656:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609c04e00/0xcd9d312a94a052f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a052e9 expref: 5 pid: 24739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938631.896669:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460a1b7a00/0xcd9d312a94a052fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a052f7 expref: 4 pid: 24715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938631.896679:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974742172400/0xcd9d312a94a05455 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a0544e expref: 3 pid: 24739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938631.896691:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609c04600/0xcd9d312a94a053c9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a0539f expref: 2 pid: 24739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938631.896701:0:15288:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97460912c800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1784938631.896714:0:15288:0:(genops.c:906:class_export_put()) final put ffff97460912c800/66ce0d8a-9177-486f-adae-cb202cd372dd 00010000:00010000:3.0:1784938631.896730:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938631.896733:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938631.896741:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938631.896822:0:24717:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97473a8a9800:24717] 2 exiting: rc = 0 00000100:00100000:3.0:1784938631.896924:0:24739:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff97472feb7800:24739] 3 exiting: rc = 0 00000100:00100000:3.0:1784938631.896972:0:24716:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff974609f81600:24716] 1 exiting: rc = 0 00000020:00000080:0.0:1784938631.897111:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974718b19000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784938631.897120:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974718b1d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784938631.897127:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974718b19800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784938631.897132:0:36:0:(genops.c:906:class_export_put()) final put ffff974718b1e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784938631.897134:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974718b1e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1784938631.897139:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784938631.897228:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974609ceb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1784938631.897233:0:36:0:(genops.c:906:class_export_put()) final put ffff97473a638800/lustre-MDD0000_UUID 00000020:00000080:0.0:1784938631.897235:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97473a638800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1784938631.897239:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1784938631.897326:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97460912f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784938631.897331:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97460912c800/66ce0d8a-9177-486f-adae-cb202cd372dd for MGS 00000100:00100000:2.0:1784938631.897479:0:24715:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97473a8a8c00:24715] 0 exiting: rc = 1 00000100:00100000:3.0:1784938631.900101:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900112:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900120:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900126:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900130:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900137:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900142:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900147:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900154:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900160:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900167:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900173:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900180:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900186:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900194:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900200:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900206:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900212:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900219:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900227:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900234:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900240:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900245:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900251:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900256:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900261:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900266:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900272:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900278:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900284:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900306:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900312:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900318:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900324:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900330:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900335:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900343:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900348:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900354:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900359:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900364:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900369:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900375:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900382:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900388:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900395:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900400:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900406:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900411:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900416:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900422:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900427:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900432:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900438:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900444:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900449:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900456:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900463:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900487:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900492:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900498:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900503:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900508:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.900513:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1784938631.901373:0:27268:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784938631.901384:0:27268:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1784938631.903689:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97460912b800 for MGS 00000020:01000000:0.0:1784938631.906108:0:27268:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97473a834840 - data ffff97473fcd1948/ffff974710d99000 00000020:01000000:0.0:1784938631.906260:0:27268:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97470682b0c0 - data ffff9746017de438/ffff974705d76000 00000020:00000080:0.0:1784938631.906981:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a051b5 00000020:00000080:0.0:1784938631.906992:0:27268:0:(genops.c:906:class_export_put()) final put ffff97460912c000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784938631.907012:0:27268:0:(tgt_mount.c:187:server_put_mount()) put mount ffff974729ecc000 from MGS, refs=2 00000020:01000004:0.0:1784938631.907016:0:27268:0:(obd_mount.c:706:lustre_put_lsi()) put ffff974729ecc000 2 00000020:01000004:0.0:1784938631.907019:0:27268:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff974729ecc000 from MGS 00000020:00000080:0.0:1784938631.907041:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938631.907048:0:27268:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1784938631.907052:0:27268:0:(genops.c:906:class_export_put()) final put ffff97460912e800/MGS 00000020:00000080:0.0:1784938631.907055:0:27268:0:(genops.c:865:class_export_destroy()) destroying export ffff97460912e800/MGS for MGS 00000020:01000000:0.0:1784938631.907062:0:27268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1784938631.907134:0:27268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1784938631.907138:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938631.907162:0:27268:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784938631.907172:0:27268:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97473e3c8000 lustre-MDT0000-lwp-MDT0000 192.168.202.104@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784938631.907178:0:27268:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff97473bae3380) has exports, disconnecting them 00000020:00080000:0.0:1784938631.907183:0:27268:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 192.168.202.104@tcp (ffff97473e3c8000), last request at 1784938542 00000020:00000080:0.0:1784938631.907187:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a052a3 00000020:00080000:0.0:1784938631.907198:0:27268:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.104@tcp (ffff97473e3c8000): rc 0 00000020:00000080:0.0:1784938631.907203:0:27268:0:(genops.c:906:class_export_put()) final put ffff97473e3c8000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784938631.907644:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97460912c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784938631.907662:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97473e3c8000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1784938631.908475:0:27268:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1784938631.908482:0:27268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938631.908487:0:27268:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784938631.908493:0:27268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784938631.908514:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974718c79000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784938631.908646:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938631.908657:0:27268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1784938631.908661:0:27268:0:(genops.c:906:class_export_put()) final put ffff97473e3cd000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784938631.908664:0:27268:0:(genops.c:865:class_export_destroy()) destroying export ffff97473e3cd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1784938631.908670:0:27268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1784938631.908727:0:27268:0:(obd_mount.c:706:lustre_put_lsi()) put ffff974729ecc000 1 00000020:00000080:1.0:1784938631.908733:0:27268:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a051a7 00000020:00000080:1.0:1784938631.908739:0:27268:0:(genops.c:906:class_export_put()) final put ffff97460912d800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1784938631.908747:0:27268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1784938631.908770:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97460912d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784938631.908780:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938631.908783:0:27268:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784938631.908787:0:27268:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff974609e88000) has no exports 00000020:00000080:1.0:1784938631.936813:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938631.936833:0:27268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784938631.936856:0:27268:0:(genops.c:906:class_export_put()) final put ffff974729ec9800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784938631.936861:0:27268:0:(genops.c:865:class_export_destroy()) destroying export ffff974729ec9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784938631.936877:0:27268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784938631.937023:0:27268:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffff974729ecf800 00000020:01000000:1.0:1784938631.937046:0:27268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1784938631.937050:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938631.937055:0:27268:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784938631.937060:0:27268:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff974729eab380) has no exports 00000100:00100000:1.0:1784938631.937125:0:24721:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff97460287b200:24721] 0 exiting: rc = 1 00000100:00100000:3.0:1784938631.939211:0:26820:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff974602e29200:26820] 3 exiting: rc = 0 00000100:00100000:3.0:1784938631.939328:0:24722:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff974708b1c400:24722] 1 exiting: rc = 0 00000100:00100000:1.0:1784938631.940112:0:24723:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff97460287a000:24723] 2 exiting: rc = 0 00000100:00100000:3.0:1784938631.943602:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943618:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943624:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943631:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943637:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943643:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943648:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943654:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943659:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943664:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943670:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943675:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943680:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943686:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943692:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943697:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943703:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943708:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943713:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943718:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943724:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943729:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943734:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943740:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943744:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943765:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943772:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943777:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943783:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943788:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943794:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943798:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943826:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943832:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943838:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943843:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943848:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943854:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943859:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943865:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943870:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943875:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943882:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943888:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943899:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943905:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943911:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943918:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943924:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943929:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943935:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943940:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943945:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943950:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943955:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943960:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943965:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943971:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943977:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943982:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943988:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943993:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.943998:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.944003:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.951684:0:24725:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff974741f42200:24725] 1 exiting: rc = 0 00000100:00100000:1.0:1784938631.951913:0:24724:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff974736468800:24724] 0 exiting: rc = 1 00000100:00100000:3.0:1784938631.952280:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952290:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952297:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952313:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952318:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952323:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952329:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952334:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952339:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952344:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952349:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952354:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952359:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952364:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952369:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952374:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952379:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952384:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952389:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952395:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952399:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952404:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952409:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952414:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952418:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952423:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952427:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952432:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952436:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952441:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952446:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952450:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952455:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952460:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952478:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952484:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952489:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952495:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952506:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952512:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952517:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952523:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952528:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952533:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952538:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952542:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952547:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952552:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952557:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952562:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952567:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952571:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952575:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952580:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952584:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952589:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952594:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952599:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952604:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952609:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952613:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952618:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952622:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.952627:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.954324:0:24726:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff97470c290c00:24726] 0 exiting: rc = 1 00000100:00100000:3.0:1784938631.965861:0:24728:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff97473942f000:24728] 1 exiting: rc = 0 00000100:00100000:1.0:1784938631.966041:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966062:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966069:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966086:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966093:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966100:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966106:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966111:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966118:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966124:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966131:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966137:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966144:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966165:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966173:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966179:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966185:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966191:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966198:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966203:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966210:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966231:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966250:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966257:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966264:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966284:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966291:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966298:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966305:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966310:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966317:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966323:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966330:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966336:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966342:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966347:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966354:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966376:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966382:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966388:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966395:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966400:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966406:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966411:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966417:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966424:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966429:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966436:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966442:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966475:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966484:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966490:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966497:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966502:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966508:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966516:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966531:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966537:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966544:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966550:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966556:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966577:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966586:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.966592:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.976574:0:24730:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff974739a28a00:24730] 0 exiting: rc = 1 00000100:00100000:1.0:1784938631.976732:0:24731:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff974729d26200:24731] 1 exiting: rc = 0 00000100:00100000:1.0:1784938631.976923:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.976931:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.976937:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.976943:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.976949:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.976956:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.976961:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.976966:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.976971:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.976976:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.976981:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.976986:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.976991:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.976996:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977001:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977007:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977013:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977018:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977023:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977029:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977034:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977040:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977045:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977052:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977057:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977063:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977533:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977539:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977544:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977549:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977554:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977560:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977565:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977571:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977578:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977583:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977588:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977593:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977598:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977604:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977609:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977615:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977619:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977624:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977630:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977635:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977640:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977645:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977650:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977656:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977662:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977667:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977674:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977679:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977685:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977690:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977696:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977701:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977707:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977713:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977719:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977735:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977740:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.977961:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978539:0:24733:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff974703c10c00:24733] 1 exiting: rc = 0 00000100:00100000:3.0:1784938631.978667:0:24732:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff974703260c00:24732] 0 exiting: rc = 1 00000100:00100000:1.0:1784938631.978842:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978850:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978855:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978859:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978864:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978869:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978878:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978883:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978888:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978893:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978897:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978902:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978907:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978911:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978915:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978920:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978924:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978929:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978936:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978941:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978946:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978951:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978955:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978961:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978966:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978971:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978977:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978982:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978987:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978992:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.978997:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979012:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979018:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979023:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979028:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979033:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979038:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979043:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979048:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979053:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979059:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979064:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979070:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979147:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979153:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979159:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979165:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979170:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979174:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979180:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979185:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979191:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979196:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979202:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979208:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979214:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979219:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979224:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979229:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979234:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979307:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979316:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979321:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.979326:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.979671:0:24734:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff97472feb7200:24734] 0 exiting: rc = 1 00000100:00100000:1.0:1784938631.980206:0:24735:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff974739a28600:24735] 1 exiting: rc = 0 00000100:00100000:1.0:1784938631.980314:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980328:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980333:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980338:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980342:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980347:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980351:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980356:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980362:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980367:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980371:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980376:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980380:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980385:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980390:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980394:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980400:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980404:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980409:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980414:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980419:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980424:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980429:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980435:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980440:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980445:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980454:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980459:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980472:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980478:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980482:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980490:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980495:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980500:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980505:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980509:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980524:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980530:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980535:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980540:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980545:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980556:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980561:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980567:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980572:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980577:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980584:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980588:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980594:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980599:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980604:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980609:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980613:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980617:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980621:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980626:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980629:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980634:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980638:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980642:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980646:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980650:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980654:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938631.980658:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938631.981639:0:24736:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff974739a28c00:24736] 0 exiting: rc = 1 00000100:00100000:3.0:1784938631.981847:0:24737:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff97460444e800:24737] 1 exiting: rc = 0 00000100:00100000:3.0:1784938631.981985:0:24738:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9747060f6400:24738] 2 exiting: rc = 0 00000100:00100000:0.0:1784938631.982109:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982119:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982124:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982130:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982136:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982143:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982149:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982155:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982170:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982178:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982183:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982190:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982195:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982201:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982207:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982213:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982219:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982226:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982231:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982237:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982244:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982250:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982255:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982262:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982282:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982290:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982295:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982301:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982307:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982312:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982319:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982324:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982341:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982361:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982368:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982373:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982447:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982455:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982462:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982484:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982556:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982561:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982567:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982575:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982580:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982585:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982590:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982596:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982602:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982608:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982613:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982618:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982623:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982628:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982633:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982638:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982643:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982648:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982653:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982666:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982672:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982677:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982683:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938631.982688:0:27268:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784938631.997482:0:27268:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938631.997499:0:27268:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1784938631.997505:0:27268:0:(genops.c:906:class_export_put()) final put ffff97460912a800/MDS_uuid 00000020:00000080:1.0:1784938631.997511:0:27268:0:(genops.c:865:class_export_destroy()) destroying export ffff97460912a800/MDS_uuid for MDS 00000020:01000000:1.0:1784938631.997519:0:27268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1784938631.997710:0:27268:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1784938632.052048:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938633.075874:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938633.076095:0:12700:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938633.076117:0:12700:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784938633.076120:0:12700:0:(import.c:65:import_set_state_nolock()) ffff974603c34000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784938633.076213:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938633.076239:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66ce0d8a-9177-486f-adae-cb202cd372dd:12802:1871643342511488:0@lo:400:kworker.0 00000400:00000100:0.0:1784938633.076293:0:12802:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643342511488 offset 0 length 224: 4 00000100:00080000:1.0:1784938633.076578:0:12700:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.202.104@tcp last attempt 781 00000100:00080000:1.0:1784938633.076587:0:12700:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784938633.076593:0:12700:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff974603c34000 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:0.0:1784938633.076663:0:12700:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97473a636d80 x1871643342511616/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938633.076687:0:12700:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938633.076691:0:12700:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784938633.076692:0:12700:0:(import.c:65:import_set_state_nolock()) ffff974601dd1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938633.076696:0:12700:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.202.104@tcp last attempt 781 00000100:00080000:0.0:1784938633.076701:0:12700:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784938633.076704:0:12700:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff974601dd1800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:0.0:1784938633.076718:0:12700:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97473a636a00 x1871643342511744/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938633.076939:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342511616:192.168.202.104@tcp:38:kworker.0 00000100:00100000:1.0:1784938633.077021:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342511744:192.168.202.104@tcp:38:kworker.0 00000400:00000100:2.0:1784938633.077622:0:12795:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.104@tcp portal 12 match 1871643342511616 offset 0 length 520: 4 00000400:00000100:2.0:1784938633.077847:0:12795:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.104@tcp portal 12 match 1871643342511744 offset 0 length 520: 4 00010000:00010000:2.0:1784938634.099510:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938635.122889:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938636.146922:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784938636.447887:0:27472:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784938636.469591:0:27472:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1784938636.469647:0:27472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b6a00/0xcd9d312a94a052e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a052f0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938636.469664:0:27472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b6a00/0xcd9d312a94a052e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a052f0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938636.469672:0:27472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b6a00/0xcd9d312a94a052e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a052f0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938636.469679:0:27472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff97460a1b6a00/0xcd9d312a94a052e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a052f0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938636.469739:0:27472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784938636.469746:0:27472:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784938636.469805:0:27472:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784938636.469820:0:27472:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97473a636d80 x1871643342511616/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 1784938648 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938636.469836:0:27472:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784938636.469842:0:27472:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784938636.469849:0:27472:0:(import.c:65:import_set_state_nolock()) ffff974603c34000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1784938636.469854:0:27472:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784938636.469857:0:27472:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97473a636d80 x1871643342511616/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 1784938648 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938636.469863:0:27472:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784938636.469866:0:27472:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:1.0:1784938636.469987:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342511616:192.168.202.104@tcp:38:kworker.0 00010000:00010000:3.0:1784938636.470139:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938636.470146:0:18251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97460a1b6a00/0xcd9d312a94a052e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a052f0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938636.470153:0:18251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460a1b6a00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938636.470157:0:18251:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97460a1b6a00/0xcd9d312a94a052e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a052f0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938636.470167:0:18251:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460a1b6a00/0xcd9d312a94a052e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a052f0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938636.470173:0:18251:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460a1b6a00/0xcd9d312a94a052e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a052f0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938636.470178:0:18251:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938636.470181:0:18251:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784938636.470183:0:18251:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784938636.470221:0:18251:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97460a1b6a00/0xcd9d312a94a052e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a052f0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938636.470227:0:18251:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938636.470257:0:18251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97460a1b6a00/0xcd9d312a94a052e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a052f0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938636.470264:0:18251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460a1b6a00/0xcd9d312a94a052e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a052f0 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938636.470276:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938636.470295:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938636.470296:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938636.470305:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938636.470321:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66ce0d8a-9177-486f-adae-cb202cd372dd:12805:1871643342511872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938636.470385:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938636.470461:0:19391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342511872 00000100:00100000:3.0:1784938636.470467:0:19391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342511872 00000100:00100000:3.0:1784938636.471093:0:19391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784938636.471101:0:19391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:12805:x1871643342511872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784938636.471108:0:19391:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938636 with bad export cookie 14816052408070721980 00010000:00010000:2.0:1784938636.474726:0:27472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c41200/0xcd9d312a94a052f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a052fe expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938636.474746:0:27472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c41200/0xcd9d312a94a052f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a052fe expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938636.474802:0:27472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c41200/0xcd9d312a94a052f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a052fe expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938636.474810:0:27472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974609c41200/0xcd9d312a94a052f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a052fe expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938636.474836:0:27472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938636.474843:0:27472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c05400/0xcd9d312a94a053d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a053de expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938636.474850:0:27472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c05400/0xcd9d312a94a053d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a053de expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938636.474856:0:27472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c05400/0xcd9d312a94a053d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a053de expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938636.474862:0:27472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974609c05400/0xcd9d312a94a053d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a053de expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938636.474881:0:27472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784938636.474895:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938636.474902:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974609c41200/0xcd9d312a94a052f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a052fe expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938636.474910:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c41200 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:0.0:1784938636.474913:0:17786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974609c41200/0xcd9d312a94a052f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a052fe expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938636.474921:0:17786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609c41200/0xcd9d312a94a052f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a052fe expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938636.474935:0:17786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609c41200/0xcd9d312a94a052f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a052fe expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938636.474941:0:17786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784938636.474944:0:17786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1784938636.474975:0:17786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974609c41200/0xcd9d312a94a052f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a052fe expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938636.474981:0:17786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938636.475002:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974609c41200/0xcd9d312a94a052f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a052fe expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938636.475009:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609c41200/0xcd9d312a94a052f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a052fe expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938636.475022:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938636.475025:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974609c05400/0xcd9d312a94a053d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a053de expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938636.475030:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c05400 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:0.0:1784938636.475033:0:17786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974609c05400/0xcd9d312a94a053d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a053de expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938636.475039:0:17786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609c05400/0xcd9d312a94a053d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a053de expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938636.475044:0:17786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609c05400/0xcd9d312a94a053d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a053de expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938636.475048:0:17786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784938636.475056:0:17786:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1784938636.475069:0:17786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974609c05400/0xcd9d312a94a053d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a053de expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938636.475075:0:17786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938636.475089:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974609c05400/0xcd9d312a94a053d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a053de expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938636.475096:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609c05400/0xcd9d312a94a053d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a053de expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938636.475105:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938636.475106:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938636.475108:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938636.475117:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938636.475134:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342512000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938636.475207:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938636.475261:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66ce0d8a-9177-486f-adae-cb202cd372dd:12802:1871643342512128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938636.475283:0:12802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1784938636.475962:0:27472:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1784938636.475969:0:27472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1784938636.475971:0:27472:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1784938636.475999:0:27472:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1784938636.476004:0:27472:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000100:00100000:2.0:1784938636.476024:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342512000 00000100:00100000:2.0:1784938636.476033:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342512000 00000100:00100000:2.0:1784938636.476081:0:17728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342512128 00000100:00100000:0.0:1784938636.476110:0:15286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784938636.476117:0:15286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:12804:x1871643342512000:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784938636.476123:0:15286:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938636 with bad export cookie 14816052408070721980 00000100:00100000:0.0:1784938636.476177:0:15286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:12804:x1871643342512000:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (969us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784938636.476185:0:15286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1784938636.476222:0:12804:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784938636.476227:0:12804:0:(import.c:65:import_set_state_nolock()) ffff9747031f8800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1784938636.476231:0:12804:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1784938636.476848:0:17728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342512128 00000100:00100000:2.0:1784938636.476988:0:17728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784938636.476995:0:17728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:12802:x1871643342512128:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784938636.477000:0:17728:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938636 with bad export cookie 14816052408070721980 00000100:00100000:2.0:1784938636.477048:0:17728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:12802:x1871643342512128:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (1764us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784938636.477056:0:17728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1784938636.477332:0:12802:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:3.0:1784938636.477464:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938636.477524:0:19391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:12805:x1871643342511872:12345-0@lo:103:ldlm_bl.0 Request processed in 6422us (7137us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784938636.477531:0:19391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1784938636.477555:0:12805:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:00000080:1.0:1784938636.481903:0:27472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938636.481925:0:27472:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784938636.481931:0:27472:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff974736680000) has no exports 00000020:00080000:1.0:1784938636.481972:0:27472:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff974736680000) has no exports 00000020:01000000:1.0:1784938636.485566:0:27472:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97474110d180 - data ffff97473fda00d8/ffff974601d33000 00000020:01000000:1.0:1784938636.486015:0:27472:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97473646d0c0 - data ffff97471e04ad80/ffff9747108c8400 00000100:00080000:0.0:1784938636.488209:0:12804:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.104@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1784938636.488215:0:12804:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784938636.488225:0:12804:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff974607d60380 x1871643342511488/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784938649 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938636.488241:0:12804:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97472fc89c00 x1871643342511872/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938652 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938636.488251:0:12804:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97473a636300 x1871643342512000/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938652 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938636.488258:0:12804:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97473a634000 x1871643342512128/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938652 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784938636.488266:0:12804:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784938636.488269:0:12804:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784938636.488270:0:12804:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1784938636.491895:0:12802:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9747031f8800 already not connected (conn 5, was 5): DISCONN 00000100:00100000:2.0:1784938636.491943:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66ce0d8a-9177-486f-adae-cb202cd372dd:12802:1871643342511488:0@lo:400:kworker.0 00000100:00100000:2.0:1784938636.491975:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66ce0d8a-9177-486f-adae-cb202cd372dd:12802:1871643342512128:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1784938636.492990:0:12805:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9747031f8800 already not connected (conn 5, was 5): DISCONN 00000100:00100000:3.0:1784938636.493008:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66ce0d8a-9177-486f-adae-cb202cd372dd:12805:1871643342511872:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1784938636.493322:0:12804:0:(import.c:65:import_set_state_nolock()) ffff9747031f8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938636.493329:0:12804:0:(import.c:510:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 695 00000100:00080000:0.0:1784938636.493337:0:12804:0:(import.c:624:import_select_connection()) MGC192.168.202.104@tcp: import ffff9747031f8800 using connection 66ce0d8a-9177-486f-adae-cb202cd372dd/0@lo 00000100:00100000:0.0:1784938636.493372:0:12804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97473a637100 x1871643342512256/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938636.493448:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:66ce0d8a-9177-486f-adae-cb202cd372dd:12801:1871643342512256:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1784938636.493558:0:12801:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643342512256 offset 0 length 520: 4 00000100:00100000:0.0:1784938636.493618:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66ce0d8a-9177-486f-adae-cb202cd372dd:12804:1871643342512000:0@lo:103:ldlm_bl.0 00100000:10000000:0.0:1784938636.509152:0:27472:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1784938636.533009:0:27472:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a949fc1d3 00000020:00000080:1.0:1784938636.533019:0:27472:0:(genops.c:906:class_export_put()) final put ffff974736481800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1784938636.533042:0:27472:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97473a63a800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1784938636.533046:0:27472:0:(obd_mount.c:706:lustre_put_lsi()) put ffff97473a63a800 2 00000020:01000004:1.0:1784938636.533049:0:27472:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97473a63a800 from lustre-OST0000 00000020:00000080:1.0:1784938636.533073:0:27472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938636.533083:0:27472:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1784938636.533086:0:27472:0:(genops.c:906:class_export_put()) final put ffff974736486000/lustre-OST0000_UUID 00000020:00000080:1.0:1784938636.533089:0:27472:0:(genops.c:865:class_export_destroy()) destroying export ffff974736486000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1784938636.533095:0:27472:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1784938636.533141:0:27472:0:(obd_mount.c:574:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1784938636.533145:0:27472:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1784938636.533161:0:27472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938636.533166:0:27472:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784938636.533174:0:27472:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff974603c35000 lustre-MDT0000-lwp-OST0000 192.168.202.104@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784938636.533180:0:27472:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff97473bae4d40) has exports, disconnecting them 00000020:00080000:1.0:1784938636.533185:0:27472:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 192.168.202.104@tcp (ffff974603c35000), last request at 1784938269 00000020:00000080:1.0:1784938636.533189:0:27472:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a949fc1fd 00000020:00080000:1.0:1784938636.533199:0:27472:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.104@tcp (ffff974603c35000): rc 0 00000020:00000080:1.0:1784938636.533203:0:27472:0:(genops.c:906:class_export_put()) final put ffff974603c35000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1784938636.533801:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974736481800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1784938636.533816:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974603c35000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1784938636.537889:0:27472:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1784938636.537904:0:27472:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784938636.537910:0:27472:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784938636.537919:0:27472:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784938636.538088:0:27472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938636.538101:0:27472:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1784938636.538109:0:27472:0:(obd_mount.c:706:lustre_put_lsi()) put ffff97473a63a800 1 00000020:00000080:2.0:1784938636.538117:0:27472:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a949fc18d 00000020:00000080:2.0:1784938636.538128:0:27472:0:(genops.c:906:class_export_put()) final put ffff974736695000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1784938636.538133:0:27472:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1784938636.538139:0:27472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938636.538145:0:27472:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784938636.538149:0:27472:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff974708a419c0) has no exports 00000020:00000080:3.0:1784938636.538243:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974603c34000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1784938636.538250:0:36:0:(genops.c:906:class_export_put()) final put ffff974603c36800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1784938636.538253:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974603c36800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1784938636.538264:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1784938636.538317:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974736695000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1784938636.571828:0:27472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938636.571847:0:27472:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1784938636.571868:0:27472:0:(genops.c:906:class_export_put()) final put ffff97473a63f800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1784938636.571874:0:27472:0:(genops.c:865:class_export_destroy()) destroying export ffff97473a63f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1784938636.571886:0:27472:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1784938636.572020:0:27472:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffff97473a639000 00000020:02000400:3.0:1784938636.572070:0:27472:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1784938637.170887:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938638.196575:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 66ce0d8a-9177-486f-adae-cb202cd372dd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938638.196583:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 66ce0d8a-9177-486f-adae-cb202cd372dd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784938638.196585:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938638.196588:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1784938638.196819:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938639.219031:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938640.242933:0:15288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784938640.413867:0:27676:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784938640.423021:0:27676:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1784938640.423102:0:27676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c41400/0xcd9d312a94a052bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a052c6 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938640.423119:0:27676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c41400/0xcd9d312a94a052bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a052c6 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938640.423127:0:27676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c41400/0xcd9d312a94a052bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a052c6 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938640.423135:0:27676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974609c41400/0xcd9d312a94a052bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a052c6 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938640.423152:0:27676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784938640.423158:0:27676:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784938640.423182:0:27676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938640.423196:0:27676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97473a636a00 x1871643342511744/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 1784938648 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938640.423210:0:27676:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784938640.423215:0:27676:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784938640.423221:0:27676:0:(import.c:65:import_set_state_nolock()) ffff974601dd1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1784938640.423241:0:27676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938640.423246:0:27676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97473a636a00 x1871643342511744/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 1784938648 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938640.423255:0:27676:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784938640.423258:0:27676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:3.0:1784938640.423423:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342511744:192.168.202.104@tcp:38:kworker.0 00010000:00010000:0.0:1784938640.423487:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938640.423495:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974609c41400/0xcd9d312a94a052bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a052c6 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938640.423503:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c41400 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:0.0:1784938640.423507:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974609c41400/0xcd9d312a94a052bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a052c6 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938640.423524:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609c41400/0xcd9d312a94a052bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a052c6 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938640.423531:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609c41400/0xcd9d312a94a052bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a052c6 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938640.423537:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784938640.423539:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784938640.423542:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784938640.423556:0:15289:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9747031f8800 00010000:00010000:0.0:1784938640.423560:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974609c41400/0xcd9d312a94a052bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd9d312a94a052c6 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938640.423566:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609c41400/0xcd9d312a94a052bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd9d312a94a052c6 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938640.423576:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938640.423578:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938640.423579:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938640.424684:0:27676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b7400/0xcd9d312a94a052cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a052d4 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938640.424697:0:27676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b7400/0xcd9d312a94a052cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a052d4 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938640.424704:0:27676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460a1b7400/0xcd9d312a94a052cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a052d4 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938640.424710:0:27676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff97460a1b7400/0xcd9d312a94a052cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a052d4 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938640.424731:0:27676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938640.424737:0:27676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c05000/0xcd9d312a94a052db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a052e2 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938640.424744:0:27676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c05000/0xcd9d312a94a052db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a052e2 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938640.424771:0:27676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609c05000/0xcd9d312a94a052db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a052e2 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938640.424778:0:27676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974609c05000/0xcd9d312a94a052db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a052e2 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938640.424806:0:27676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1784938640.424812:0:27676:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1784938640.424832:0:27676:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1784938640.424837:0:27676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1784938640.424842:0:27676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938640.424847:0:27676:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784938640.424851:0:27676:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff974729ea8000) has no exports 00000020:00080000:1.0:1784938640.424878:0:27676:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff974729ea8000) has no exports 00010000:00010000:0.0:1784938640.424979:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938640.424987:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97460a1b7400/0xcd9d312a94a052cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a052d4 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938640.424995:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460a1b7400 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:0.0:1784938640.424998:0:17786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97460a1b7400/0xcd9d312a94a052cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a052d4 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938640.425007:0:17786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460a1b7400/0xcd9d312a94a052cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a052d4 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938640.425025:0:17786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460a1b7400/0xcd9d312a94a052cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a052d4 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938640.425031:0:17786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784938640.425034:0:17786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1784938640.425036:0:17786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1784938640.425047:0:17786:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9747031f8800 00010000:00010000:0.0:1784938640.425051:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97460a1b7400/0xcd9d312a94a052cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd9d312a94a052d4 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938640.425057:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460a1b7400/0xcd9d312a94a052cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd9d312a94a052d4 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938640.425069:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938640.425073:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974609c05000/0xcd9d312a94a052db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a052e2 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938640.425078:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c05000 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:0.0:1784938640.425081:0:17786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974609c05000/0xcd9d312a94a052db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a052e2 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938640.425088:0:17786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609c05000/0xcd9d312a94a052db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a052e2 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938640.425094:0:17786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609c05000/0xcd9d312a94a052db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a052e2 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938640.425099:0:17786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784938640.425101:0:17786:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784938640.425108:0:17786:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784938640.425113:0:17786:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9747031f8800 00010000:00010000:0.0:1784938640.425116:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974609c05000/0xcd9d312a94a052db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd9d312a94a052e2 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938640.425123:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609c05000/0xcd9d312a94a052db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd9d312a94a052e2 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938640.425135:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938640.425137:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938640.425138:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1784938640.426783:0:27676:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97474110d660 - data ffff97471e05eaf8/ffff97471d9eb800 00000020:01000000:1.0:1784938640.426927:0:27676:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97470995c2a0 - data ffff97472c7945e8/ffff974601d31400 00010000:00010000:3.0:1784938640.427246:0:18251:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1784938640.450274:0:27676:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1784938640.476187:0:27676:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a949fc29e 00000020:00000080:2.0:1784938640.476202:0:27676:0:(genops.c:906:class_export_put()) final put ffff9746026f3000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1784938640.476244:0:27676:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9746020cd000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1784938640.476249:0:27676:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9746020cd000 2 00000020:01000004:2.0:1784938640.476253:0:27676:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9746020cd000 from lustre-OST0001 00000020:00000080:2.0:1784938640.476283:0:27676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938640.476294:0:27676:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1784938640.476297:0:27676:0:(genops.c:906:class_export_put()) final put ffff9746026f4000/lustre-OST0001_UUID 00000020:00000080:2.0:1784938640.476300:0:27676:0:(genops.c:865:class_export_destroy()) destroying export ffff9746026f4000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1784938640.476308:0:27676:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1784938640.476542:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9746026f3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1784938640.476594:0:27676:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 66ce0d8a-9177-486f-adae-cb202cd372dd->MGS 00010000:00010000:2.0:1784938640.476615:0:27676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609c04000/0xcd9d312a94a0539f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a053c9 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938640.476631:0:27676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609c04000/0xcd9d312a94a0539f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a053c9 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938640.476639:0:27676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1784938640.476643:0:27676:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1784938640.476647:0:27676:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1784938640.476666:0:27676:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9747031f8800 00010000:00010000:2.0:1784938640.476669:0:27676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609c04000/0xcd9d312a94a0539f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd9d312a94a053c9 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938640.476685:0:27676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974742173000/0xcd9d312a94a0544e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a05455 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938640.476692:0:27676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974742173000/0xcd9d312a94a0544e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a05455 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938640.476697:0:27676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938640.476700:0:27676:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1784938640.476702:0:27676:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1784938640.476719:0:27676:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9747031f8800 00010000:00010000:2.0:1784938640.476722:0:27676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974742173000/0xcd9d312a94a0544e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd9d312a94a05455 expref: -99 pid: 15297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784938640.476743:0:27676:0:(import.c:65:import_set_state_nolock()) ffff9747031f8800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1784938640.476747:0:27676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784938640.476939:0:27676:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784938640.476942:0:27676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784938640.481837:0:27676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784938640.481862:0:27676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97473a637100 x1871643342512256/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784938646 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784938640.481889:0:27676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1784938640.481893:0:27676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:3.0:1784938640.481986:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:66ce0d8a-9177-486f-adae-cb202cd372dd:12801:1871643342512256:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:0.0:1784938640.482102:0:27676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1784938640.482116:0:27676:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a949fc091 00000020:00000080:0.0:1784938640.482124:0:27676:0:(genops.c:906:class_export_put()) final put ffff9747031fe000/66ce0d8a-9177-486f-adae-cb202cd372dd 00000020:01000000:0.0:1784938640.482146:0:27676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.104@tcp (flags='') 00000020:00000080:0.0:1784938640.482155:0:27676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938640.482163:0:27676:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.104@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784938640.482168:0:27676:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff974729eacd40) has no exports 10000000:01000000:3.0:1784938640.482225:0:15297:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1784938640.482327:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9747031fe000/66ce0d8a-9177-486f-adae-cb202cd372dd for MGC192.168.202.104@tcp 10000000:01000000:0.0:1784938640.482363:0:27676:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.104@tcp: client import never connected 00000100:00080000:0.0:1784938640.482366:0:27676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1784938640.482368:0:27676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1784938640.482370:0:27676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1784938640.482372:0:27676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1784938640.482441:0:27676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938640.482449:0:27676:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.104@tcp (uuid 66ce0d8a-9177-486f-adae-cb202cd372dd) 00000020:01000000:0.0:1784938640.482455:0:27676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1784938640.482481:0:27676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938640.482485:0:27676:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784938640.482492:0:27676:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9746026f1800 lustre-MDT0000-lwp-OST0001 192.168.202.104@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784938640.482498:0:27676:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff974708a44d40) has exports, disconnecting them 00000020:00080000:0.0:1784938640.482503:0:27676:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 192.168.202.104@tcp (ffff9746026f1800), last request at 1784938286 00000020:00000080:0.0:1784938640.482508:0:27676:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a949fc2c8 00000020:00080000:0.0:1784938640.482518:0:27676:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.104@tcp (ffff9746026f1800): rc 0 00000020:00000080:0.0:1784938640.482522:0:27676:0:(genops.c:906:class_export_put()) final put ffff9746026f1800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1784938640.482888:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9747031f8800 for MGC192.168.202.104@tcp 00000020:00000080:2.0:1784938640.482896:0:36:0:(genops.c:906:class_export_put()) final put ffff9747101c5800/66ce0d8a-9177-486f-adae-cb202cd372dd 00000020:00000080:2.0:1784938640.482898:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9747101c5800/66ce0d8a-9177-486f-adae-cb202cd372dd for MGC192.168.202.104@tcp 00000020:01000000:2.0:1784938640.482905:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.104@tcp (66ce0d8a-9177-486f-adae-cb202cd372dd) 00000020:00000080:2.0:1784938640.483174:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9746026f1800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1784938640.531928:0:27676:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1784938640.531940:0:27676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784938640.531947:0:27676:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784938640.531956:0:27676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784938640.532082:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974601dd1800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1784938640.532144:0:15288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1784938640.532348:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1784938640.533097:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1784938640.533264:0:18251:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1784938640.534002:0:15283:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff974717f90400:15283] 0 exiting: rc = 1 00000100:00100000:3.0:1784938640.534382:0:15284:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff974717f90e00:15284] 1 exiting: rc = 0 00000100:00100000:0.0:1784938640.534485:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.535124:0:17728:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9746026f8600:17728] 3 exiting: rc = 0 00000100:00100000:2.0:1784938640.535196:0:15285:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff97473f71ee00:15285] 0 exiting: rc = 1 00000100:00100000:2.0:1784938640.535261:0:19391:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff974739470200:19391] 4 exiting: rc = 0 00000100:00100000:3.0:1784938640.535485:0:15286:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff97473f71e000:15286] 1 exiting: rc = 0 00000100:00100000:3.0:1784938640.535917:0:15287:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff97473f71ec00:15287] 2 exiting: rc = 0 00000100:00100000:0.0:1784938640.536011:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536018:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536023:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536029:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536034:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536046:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536052:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536058:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536063:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536069:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536074:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536081:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536087:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536093:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536098:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536105:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536111:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536117:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536128:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536147:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536153:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536159:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536166:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536172:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536178:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536184:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536190:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536196:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536202:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536209:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536216:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536222:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536237:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536242:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536248:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536255:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536262:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536267:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536273:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536279:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536284:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536289:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536295:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536301:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536307:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536312:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536318:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536323:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536328:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536333:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536339:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536345:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536350:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536354:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536367:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536373:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536378:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536383:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536389:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536404:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536411:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536417:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536422:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.536428:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784938640.537994:0:27676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938640.538008:0:27676:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1784938640.538014:0:27676:0:(genops.c:906:class_export_put()) final put ffff974601dd5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1784938640.538019:0:27676:0:(genops.c:865:class_export_destroy()) destroying export ffff974601dd5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1784938640.538030:0:27676:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1784938640.538077:0:27676:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9746020cd000 1 00000020:00000080:0.0:1784938640.538084:0:27676:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a949fc26d 00000020:00000080:0.0:1784938640.538090:0:27676:0:(genops.c:906:class_export_put()) final put ffff9747360d8000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1784938640.538112:0:27676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1784938640.538118:0:27676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938640.538122:0:27676:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784938640.538126:0:27676:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff974708a40000) has no exports 00000020:00000080:2.0:1784938640.538304:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9747360d8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1784938640.590591:0:27676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938640.590607:0:27676:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1784938640.590613:0:27676:0:(genops.c:906:class_export_put()) final put ffff9747294aa000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1784938640.590618:0:27676:0:(genops.c:865:class_export_destroy()) destroying export ffff9747294aa000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1784938640.590628:0:27676:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1784938640.591294:0:27676:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffff9747294ab000 00000020:01000000:0.0:1784938640.591317:0:27676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1784938640.591321:0:27676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938640.591326:0:27676:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784938640.591330:0:27676:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff97473bae0000) has no exports 00000020:00000080:0.0:1784938640.591354:0:27676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938640.591370:0:27676:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1784938640.591373:0:27676:0:(genops.c:906:class_export_put()) final put ffff974736694000/OSS_uuid 00000020:00000080:0.0:1784938640.591376:0:27676:0:(genops.c:865:class_export_destroy()) destroying export ffff974736694000/OSS_uuid for OSS 00000020:01000000:0.0:1784938640.591380:0:27676:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1784938640.591510:0:16104:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff97473f4efc00:16104] 1 exiting: rc = 0 00000100:00100000:0.0:1784938640.591592:0:19396:0:(service.c:3183:ptlrpc_main()) ll_ost00_011: service thread [ffff974718c48800:19396] 11 exiting: rc = 0 00000100:00100000:0.0:1784938640.591638:0:19390:0:(service.c:3183:ptlrpc_main()) ll_ost00_006: service thread [ffff9746026f8800:19390] 6 exiting: rc = 0 00000100:00100000:0.0:1784938640.591685:0:16102:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff97473bb18c00:16102] 0 exiting: rc = 1 00000100:00080000:1.0:1784938640.591776:0:15296:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1784938640.591884:0:19393:0:(service.c:3183:ptlrpc_main()) ll_ost00_008: service thread [ffff974706b26e00:19393] 8 exiting: rc = 0 00000100:00100000:1.0:1784938640.591940:0:19388:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff974710452200:19388] 4 exiting: rc = 0 00000100:00100000:1.0:1784938640.591985:0:19398:0:(service.c:3183:ptlrpc_main()) ll_ost00_013: service thread [ffff974609eff200:19398] 13 exiting: rc = 0 00000100:00100000:1.0:1784938640.592033:0:19399:0:(service.c:3183:ptlrpc_main()) ll_ost00_014: service thread [ffff974601cd7000:19399] 14 exiting: rc = 0 00000100:00100000:0.0:1784938640.593051:0:19397:0:(service.c:3183:ptlrpc_main()) ll_ost00_012: service thread [ffff974601cd7200:19397] 12 exiting: rc = 0 00000100:00100000:0.0:1784938640.593111:0:17487:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff974702dd0400:17487] 3 exiting: rc = 0 00000100:00100000:0.0:1784938640.593169:0:19405:0:(service.c:3183:ptlrpc_main()) ll_ost00_015: service thread [ffff97460a0f2200:19405] 15 exiting: rc = 0 00000100:00100000:0.0:1784938640.593238:0:19392:0:(service.c:3183:ptlrpc_main()) ll_ost00_007: service thread [ffff974601263a00:19392] 7 exiting: rc = 0 00000100:00100000:0.0:1784938640.593286:0:19394:0:(service.c:3183:ptlrpc_main()) ll_ost00_009: service thread [ffff974735254400:19394] 9 exiting: rc = 0 00000100:00100000:3.0:1784938640.594171:0:19395:0:(service.c:3183:ptlrpc_main()) ll_ost00_010: service thread [ffff9746010aac00:19395] 10 exiting: rc = 0 00000100:00100000:3.0:1784938640.594243:0:16105:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff974741f80400:16105] 2 exiting: rc = 0 00000100:00100000:3.0:1784938640.594292:0:19389:0:(service.c:3183:ptlrpc_main()) ll_ost00_005: service thread [ffff974602c31200:19389] 5 exiting: rc = 0 00000100:00100000:1.0:1784938640.594449:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594468:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594475:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594487:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594499:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594507:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594513:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594523:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594530:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594536:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594542:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594554:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594562:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594569:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594586:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594592:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594598:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594604:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594610:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594616:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594622:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594628:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594634:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594639:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594645:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594651:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594657:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594662:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594667:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594672:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594677:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594682:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594687:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594691:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594697:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594702:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594707:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594712:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594716:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594721:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594726:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594731:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594736:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594741:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594746:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594770:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594776:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594782:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594787:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594802:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594807:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594812:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594817:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594822:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594827:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594832:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594837:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594842:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594848:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594853:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594873:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594879:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594885:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938640.594895:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.596210:0:16107:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff974741f81800:16107] 1 exiting: rc = 0 00000100:00100000:3.0:1784938640.597699:0:16106:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff974741f81600:16106] 0 exiting: rc = 1 00000100:00100000:3.0:1784938640.597817:0:19601:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff974707f3ea00:19601] 2 exiting: rc = 0 00000100:00100000:0.0:1784938640.598008:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598018:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598023:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598029:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598034:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598039:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598044:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598049:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598055:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598061:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598067:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598072:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598077:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598082:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598087:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598093:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598098:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598104:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598109:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598123:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598127:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598132:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598137:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598142:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598147:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598152:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598157:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598161:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598166:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598170:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598174:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598179:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598184:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598189:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598193:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598198:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598202:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598207:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598212:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598217:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598223:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598229:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598234:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598239:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598244:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598249:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598254:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598259:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598264:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598270:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598275:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598280:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598287:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598292:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598306:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598311:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598316:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598320:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598325:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598330:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598335:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598340:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598344:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.598350:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938640.611820:0:18061:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff9746035b3000:18061] 4 exiting: rc = 0 00000100:00100000:2.0:1784938640.612098:0:18064:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_007: service thread [ffff9746028bcc00:18064] 7 exiting: rc = 0 00000100:00100000:3.0:1784938640.612345:0:18052:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff974739a28000:18052] 3 exiting: rc = 0 00000100:00100000:1.0:1784938640.612740:0:18065:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_008: service thread [ffff974736456000:18065] 8 exiting: rc = 0 00000100:00100000:2.0:1784938640.620989:0:19417:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_012: service thread [ffff974601cd7c00:19417] 12 exiting: rc = 0 00000100:00100000:0.0:1784938640.621293:0:16109:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff974741f80e00:16109] 1 exiting: rc = 0 00000100:00100000:2.0:1784938640.625404:0:16108:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff974741f80200:16108] 0 exiting: rc = 1 00000100:00100000:3.0:1784938640.625744:0:16110:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff97473a632800:16110] 2 exiting: rc = 0 00000100:00100000:3.0:1784938640.626035:0:19416:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_011: service thread [ffff974704ce8600:19416] 11 exiting: rc = 0 00000100:00100000:1.0:1784938640.632543:0:18066:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_009: service thread [ffff974602c30a00:18066] 9 exiting: rc = 0 00000100:00100000:2.0:1784938640.635738:0:18062:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_005: service thread [ffff9746028bd600:18062] 5 exiting: rc = 0 00000100:00100000:0.0:1784938640.635936:0:18063:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_006: service thread [ffff974713434200:18063] 6 exiting: rc = 0 00000100:00100000:0.0:1784938640.636121:0:19412:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_010: service thread [ffff97472a9c6000:19412] 10 exiting: rc = 0 00000100:00100000:2.0:1784938640.636725:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.636735:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.636744:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.636940:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.636959:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.636966:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.636971:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.636976:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.636982:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.636987:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.636993:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.636997:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637003:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637009:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637014:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637020:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637026:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637030:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637036:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637041:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637046:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637053:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637058:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637063:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637069:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637074:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637079:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637084:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637089:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637110:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637117:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637123:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637128:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637134:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637139:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637143:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637149:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637154:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637159:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637171:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637176:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637182:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637187:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637193:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637198:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637203:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637209:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637217:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637222:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637227:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637232:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637238:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637244:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637265:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637271:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637277:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637282:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637287:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637292:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637297:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637303:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637316:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637323:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.637329:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.647976:0:16111:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff974708afbc00:16111] 0 exiting: rc = 1 00000100:00100000:2.0:1784938640.648076:0:16112:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff974708afa200:16112] 1 exiting: rc = 0 00000100:00100000:2.0:1784938640.648133:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648141:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648146:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648150:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648156:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648161:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648167:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648172:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648191:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648195:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648201:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648206:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648213:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648218:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648223:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648228:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648234:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648239:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648244:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648249:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648254:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648259:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648263:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648269:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648275:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648280:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648286:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648291:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648296:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648300:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648305:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648310:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648314:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648319:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648325:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648330:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648335:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648339:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648345:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648350:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648355:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648361:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648366:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648380:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648385:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648390:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648407:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648412:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648417:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648423:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648428:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648432:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648437:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648444:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648450:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.648455:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.652704:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.652711:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.652715:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.652719:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.652724:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.652729:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.652733:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.652738:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.656699:0:19384:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_003: service thread [ffff97473baf5200:19384] 3 exiting: rc = 0 00000100:00100000:2.0:1784938640.658184:0:19383:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_002: service thread [ffff974601262a00:19383] 2 exiting: rc = 0 00000100:00100000:1.0:1784938640.660178:0:16114:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff974740f9e400:16114] 1 exiting: rc = 0 00000100:00100000:1.0:1784938640.660305:0:16113:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff97473608a200:16113] 0 exiting: rc = 1 00000100:00100000:2.0:1784938640.660454:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660475:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660481:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660496:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660504:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660510:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660515:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660520:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660539:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660547:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660552:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660557:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660579:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660584:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660590:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660595:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660601:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660606:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660611:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660617:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660635:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660642:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660648:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660654:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660660:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660667:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660672:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660679:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660686:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660691:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660696:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660701:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660724:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660731:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660738:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660745:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660780:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660788:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660794:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660800:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660806:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660811:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660817:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660822:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660842:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660849:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660855:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660869:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660876:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660882:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660888:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660893:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660899:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660904:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660910:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660916:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660938:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660945:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660951:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660958:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660964:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660969:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660976:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938640.660981:0:27676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1784938640.673649:0:27676:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1784938648.180690:0:28023:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_hostid 00000001:02000400:3.0:1784938657.000316:0:28219:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing load_modules_local 00000001:02000400:2.0:1784938711.715294:0:30077:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1784938721.336632:0:30610:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:3.0:1784938721.336638:0:30610:0:(obd_mount.c:922:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1784938721.336796:0:30610:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9747294ad000 00000020:01000004:3.0:1784938721.338266:0:30610:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1784938721.338277:0:30610:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784938721.338291:0:30610:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff974609e899c0) 00000020:00000080:3.0:1784938721.338306:0:30610:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1784938721.432638:0:30610:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1784938721.434364:0:30610:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1784938721.592243:0:30610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784938721.592392:0:30610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784938721.592419:0:30610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784938721.592572:0:30610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784938721.592700:0:30610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784938721.593421:0:30610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784938721.593429:0:30610:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784938721.593439:0:30610:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a06b8c 00000020:01000004:2.0:1784938721.593448:0:30610:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1784938721.593453:0:30610:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1784938721.593457:0:30610:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9747294ad000 from MGS 00000020:01000004:2.0:1784938721.593467:0:30610:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1784938721.593477:0:30610:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff974736680000) 00000020:00000080:2.0:1784938721.593487:0:30610:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1784938721.593534:0:30610:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9747294ad000 from MGS, refs=2 00080000:01000000:2.0:1784938721.593539:0:30610:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784938721.593543:0:30610:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a06b9a 00000100:00100000:2.0:1784938721.593629:0:30610:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1784938721.593773:0:30610:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1784938721.593780:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1784938721.594244:0:30610:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1784938721.594251:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1784938721.595081:0:30610:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938721.595224:0:30610:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1784938721.595230:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1784938721.595656:0:30610:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1784938721.595663:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1784938721.596053:0:30610:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1784938721.596061:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1784938721.596628:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938721.596632:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938721.596634:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938721.597003:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938721.597005:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938721.597007:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938721.597428:0:30610:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1784938721.602912:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1784938721.603322:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1784938721.705341:0:30610:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1784938721.705358:0:30610:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784938721.705361:0:30610:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1784938721.709462:0:30621:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784938721.709747:0:30610:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784938721.709887:0:30610:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1784938721.710377:0:30610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784938721.710399:0:30610:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784938721.710633:0:30610:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938721.710978:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784938721.710986:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784938721.711688:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784938721.711695:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1784938721.712782:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1784938721.712794:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1784938721.713837:0:30610:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1784938721.713864:0:30610:0:(obd_mount.c:414:lustre_start_mgc()) Start MGC 'MGC192.168.202.104@tcp' 00000020:01000004:0.0:1784938721.713866:0:30610:0:(obd_mount.c:423:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1784938721.713890:0:30610:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGC192.168.202.104@tcp (typ=mgc) 00000020:00000080:0.0:1784938721.713903:0:30610:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.104@tcp (ffff97473bae19c0) 00000020:00000080:0.0:1784938721.713919:0:30610:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1784938721.714002:0:30610:0:(ldlm_lib.c:125:import_set_conn()) imp ffff974736697800@MGC192.168.202.104@tcp: add connection 0@lo at head 00010000:00010000:0.0:1784938721.714141:0:30610:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.104@tcp-0 is initialized 00000040:01000000:0.0:1784938721.714148:0:30610:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 1 is initialized 10000000:01000000:0.0:1784938721.714548:0:30627:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1784938721.714611:0:30610:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.104@tcp (uuid 754ce9ff-680f-4784-b8fd-fa933d4638f3) 00000020:00000080:1.0:1784938721.714627:0:30610:0:(genops.c:1406:class_connect()) connect: client 754ce9ff-680f-4784-b8fd-fa933d4638f3, cookie 0xcd9d312a94a06ba8 00000100:00080000:1.0:1784938721.714641:0:30610:0:(import.c:510:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784938721.714646:0:30610:0:(import.c:624:import_select_connection()) MGC192.168.202.104@tcp: import ffff974736697800 using connection 754ce9ff-680f-4784-b8fd-fa933d4638f3/0@lo 00000100:00100000:1.0:1784938721.714677:0:30610:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974607d60a80 x1871643342512384/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938721.714702:0:30610:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 754ce9ff-680f-4784-b8fd-fa933d4638f3->MGS 00000020:01000004:1.0:1784938721.714720:0:30610:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784938721.714725:0:30610:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1784938721.714742:0:30610:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9747034ab380) 00000020:00000080:1.0:1784938721.714769:0:30610:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1784938721.715925:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:754ce9ff-680f-4784-b8fd-fa933d4638f3:12801:1871643342512384:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784938721.716004:0:12801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784938721.718701:0:30626:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1784938721.721681:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342512384 00000100:00100000:0.0:1784938721.721696:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342512384 00000100:00100000:0.0:1784938721.721819:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784938721.721835:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:12801:x1871643342512384:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1784938721.721868:0:30623:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from 754ce9ff-680f-4784-b8fd-fa933d4638f3@0@lo t0 exp 0000000000000000 cur 875 last 0 00000020:00000080:0.0:1784938721.721900:0:30623:0:(genops.c:1406:class_connect()) connect: client 754ce9ff-680f-4784-b8fd-fa933d4638f3, cookie 0xcd9d312a94a06bb6 00000100:00080000:0.0:1784938721.722041:0:30623:0:(import.c:65:import_set_state_nolock()) ffff974736696000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938721.722144:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+5:12801:x1871643342512384:12345-0@lo:250:mount.lustre.0 Request processed in 309us (6139us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938721.722152:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784938721.722199:0:12801:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1784938721.722209:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1784938721.722217:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784938721.722223:0:12801:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784938721.722226:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974736697800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784938721.722228:0:12801:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784938721.722236:0:12801:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784938721.722241:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:754ce9ff-680f-4784-b8fd-fa933d4638f3:12801:1871643342512384:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1784938721.730184:0:30610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938721.730375:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784938721.730381:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1784938721.731435:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1784938721.731444:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1784938721.732268:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1784938721.732276:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1784938721.733238:0:30610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938721.733392:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1784938721.733398:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1784938721.734169:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1784938721.734177:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1784938721.762310:0:30610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938721.762536:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1784938721.762544:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1784938721.763568:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1784938721.763578:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1784938721.764227:0:30610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938721.764359:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784938721.764364:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1784938721.764698:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784938721.764704:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1784938721.765407:0:30610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938721.765536:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784938721.765541:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1784938721.765979:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784938721.765984:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1784938721.766390:0:30610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938721.766498:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784938721.766502:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1784938721.766991:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784938721.766996:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784938721.779414:0:30610:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938721.779607:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784938721.779614:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784938721.781002:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784938721.781019:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784938721.781689:0:30610:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784938721.781697:0:30610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784938721.782603:0:30610:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784938721.782624:0:30610:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1784938721.782631:0:30610:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784938721.782932:0:30610:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784938721.782964:0:30610:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1784938721.782969:0:30610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784938721.782970:0:30610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784938721.782971:0:30610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938721.782972:0:30610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938721.782974:0:30610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938721.782975:0:30610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938721.782976:0:30610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938721.782978:0:30610:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784938721.782979:0:30610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938721.782981:0:30610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938721.782982:0:30610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938721.782984:0:30610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938721.782986:0:30610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1784938721.782989:0:30610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784938721.782990:0:30610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784938721.782991:0:30610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938721.782992:0:30610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938721.782993:0:30610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938721.782994:0:30610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938721.782995:0:30610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938721.782997:0:30610:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784938721.782997:0:30610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938721.782998:0:30610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938721.782999:0:30610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938721.783000:0:30610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938721.783035:0:30610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784938721.783054:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc89c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342512512:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784938721.783122:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938721.783194:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747362b59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938721.783250:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342512512 00000100:00100000:1.0:1784938721.783257:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342512512 00000100:00100000:1.0:1784938721.783330:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784938721.783339:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+5:30610:x1871643342512512:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784938721.783386:0:30625:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784938721.783389:0:30625:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1784938721.783646:0:30646:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784938721.783918:0:30625:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1784938721.784196:0:30625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938721.785277:0:30647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1784938721.785466:0:30625:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784938721.785470:0:30625:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1784938721.785479:0:30625:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1784938721.785482:0:30625:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1784938721.785497:0:30625:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1784938721.785643:0:30625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938721.786064:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1784938721.786078:0:30625:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784938721.786120:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1784938721.786159:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1784938721.786188:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1784938721.786263:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1784938721.786270:0:30625:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1784938721.786311:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1784938721.786319:0:30625:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1784938721.786352:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1784938721.786359:0:30625:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1784938721.786389:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1784938721.786455:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1784938721.786488:0:30625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1784938721.786493:0:30625:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1784938721.786508:0:30625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938721.786669:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1784938721.786678:0:30625:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784938721.786714:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1784938721.786948:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1784938721.787003:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1784938721.787016:0:30625:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1784938721.787090:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1784938721.787099:0:30625:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784938721.787145:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1784938721.787183:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1784938721.787218:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1784938721.787230:0:30625:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1784938721.787325:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1784938721.787334:0:30625:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1784938721.787363:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1784938721.787398:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1784938721.787570:0:30625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1784938721.787624:0:30625:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1784938721.787633:0:30625:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1784938721.788157:0:30648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1784938721.788417:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1784938721.788440:0:30625:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.104@tcp for mdt 20000000:01000000:1.0:1784938721.788443:0:30625:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:1.0:1784938721.788477:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1784938721.788485:0:30625:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784938721.788512:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1784938721.788518:0:30625:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:1.0:1784938721.788556:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1784938721.788564:0:30625:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1784938721.788612:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1784938721.788647:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1784938721.788700:0:30625:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784938721.788703:0:30625:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784938721.788709:0:30625:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1784938721.788715:0:30625:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1784938721.789330:0:30649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1784938721.789433:0:30625:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1784938721.796086:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1784938721.796148:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1784938721.796221:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1784938721.796243:0:30625:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784938721.796246:0:30625:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784938721.796250:0:30625:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784938721.796273:0:30625:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784938721.796277:0:30625:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784938721.796312:0:30625:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784938721.796316:0:30625:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784938721.799354:0:30650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1784938721.799689:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1784938721.799747:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1784938721.800120:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1784938721.800134:0:30625:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784938721.800137:0:30625:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784938721.800559:0:30651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1784938721.800834:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1784938721.800893:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1784938721.800927:0:30625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 10000000:01000000:2.0:1784938721.800946:0:30625:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784938721.800969:0:30625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bbd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.800986:0:30625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bbd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.800998:0:30625:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bbd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.801005:0:30625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bbd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.801011:0:30625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bbd lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.801018:0:30625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bbd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.801023:0:30625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924ec00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938721.801028:0:30625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bbd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.801035:0:30625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.801048:0:30625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bbd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.801062:0:30625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.801068:0:30625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bbd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784938721.801084:0:30625:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1784938721.843911:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc89c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342512512:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784938721.843930:0:30610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784938721.843933:0:30610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784938721.843935:0:30610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938721.843937:0:30610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938721.843938:0:30610:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1784938721.843940:0:30610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938721.843941:0:30610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938721.843942:0:30610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938721.843943:0:30610:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938721.843945:0:30610:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784938721.843946:0:30610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938721.843948:0:30610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784938721.843968:0:30610:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9747294ad000 from lustre-MDT0000 10000000:01000000:0.0:1784938721.843996:0:30610:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784938721.844011:0:30610:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784938721.844016:0:30610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97473bae19c0 10000000:01000000:0.0:1784938721.844019:0:30610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784938721.844027:0:30610:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97473bae19c0 from 1 10000000:01000000:0.0:1784938721.844030:0:30610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784938721.844072:0:30610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938721.844082:0:30610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938721.844092:0:30610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938721.844110:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342512640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938721.844224:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938721.844371:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff974702ec8600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938721.844431:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342512640 00000100:00100000:1.0:1784938721.844438:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342512640 00000100:00100000:1.0:1784938721.844473:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784938721.844483:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:30610:x1871643342512640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938721.844496:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938721.844509:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974735f28c00/0xcd9d312a94a06bcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06bc4 expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938721.844529:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974735f28c00/0xcd9d312a94a06bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06bc4 expref: 7 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938721.844539:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974735f28c00/0xcd9d312a94a06bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06bc4 expref: 7 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938721.844547:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f28c00, rc 0) 00000100:00100000:1.0:1784938721.844586:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+7:30610:x1871643342512640:12345-0@lo:101:mount.lustre.0 Request processed in 104us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938721.844593:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784938721.844668:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342512640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938721.844681:0:30610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06bcb expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938721.844690:0:30610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06bcb expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938721.844765:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342512768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938721.844794:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938721.844877:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff974702ec8600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938721.844932:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342512768 00000100:00100000:1.0:1784938721.844936:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342512768 00000100:00100000:1.0:1784938721.844953:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784938721.844967:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+7:30610:x1871643342512768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938721.845193:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+7:30610:x1871643342512768:12345-0@lo:501:mount.lustre.0 Request processed in 226us (398us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784938721.845201:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784938721.845273:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:30610:x1871643342512512:12345-0@lo:253:mount.lustre.0 Request processed in 61934us (62150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938721.845285:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784938721.845360:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342512768:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1784938721.845386:0:30610:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784938721.845404:0:30610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06bcb expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938721.845413:0:30610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06bcb expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938721.845421:0:30610:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9747294ad000 10000000:01000000:0.0:1784938721.845425:0:30610:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784938721.845428:0:30610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9747294ad000 10000000:01000000:0.0:1784938721.845431:0:30610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784938721.845433:0:30610:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9747294ad000 from 1 10000000:01000000:0.0:1784938721.845436:0:30610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784938721.845453:0:30610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938721.845461:0:30610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938721.845469:0:30610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938721.845481:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342512896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938721.845506:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938721.845613:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342512896 00000100:00100000:2.0:1784938721.845619:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342512896 00000100:00100000:2.0:1784938721.845646:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784938721.845653:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:30610:x1871643342512896:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938721.845661:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938721.845671:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06bd2 expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.845687:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06bd2 expref: 7 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.845695:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06bd2 expref: 7 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.845703:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924ec00, rc 0) 00000100:00100000:2.0:1784938721.845730:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+7:30610:x1871643342512896:12345-0@lo:101:mount.lustre.0 Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938721.845748:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784938721.845983:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff974702ec8600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938721.845997:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342512896:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938721.846007:0:30610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938721.846015:0:30610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938721.846034:0:30610:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784938721.846085:0:30610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938721.846093:0:30610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938721.846099:0:30610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784938721.846103:0:30610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784938721.846107:0:30610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9747294ad000 10000000:01000000:0.0:1784938721.846110:0:30610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784938721.846114:0:30610:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784938721.846117:0:30610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784938721.846132:0:30610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938721.846139:0:30610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938721.846146:0:30610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938721.846159:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342513024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938721.846185:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938721.846247:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff974702ec8600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938721.846304:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342513024 00000100:00100000:2.0:1784938721.846308:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342513024 00000100:00100000:2.0:1784938721.846375:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784938721.846383:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+7:30610:x1871643342513024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938721.846390:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938721.846398:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460924e400/0xcd9d312a94a06be7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06be0 expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.846413:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924e400/0xcd9d312a94a06be7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06be0 expref: 8 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.846422:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460924e400/0xcd9d312a94a06be7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06be0 expref: 8 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938721.846428:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924e400, rc 0) 00000100:00100000:2.0:1784938721.846467:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:30610:x1871643342513024:12345-0@lo:101:mount.lustre.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938721.846473:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784938721.846535:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342513024:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938721.846545:0:30610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06be7 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938721.846551:0:30610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06be7 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938721.846591:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342513152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938721.846619:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938721.846705:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747362b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938721.846891:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342513152 00000100:00100000:0.0:1784938721.846895:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342513152 00000100:00100000:0.0:1784938721.846917:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784938721.846932:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:30610:x1871643342513152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938721.847153:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:30610:x1871643342513152:12345-0@lo:501:mount.lustre.0 Request processed in 221us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938721.847159:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784938721.847231:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342513152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938721.847260:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342513280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938721.847298:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938721.847324:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747362b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938721.847373:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342513280 00000100:00100000:0.0:1784938721.847377:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342513280 00000100:00100000:0.0:1784938721.847394:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784938721.847399:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:30610:x1871643342513280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938721.847544:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:30610:x1871643342513280:12345-0@lo:503:mount.lustre.0 Request processed in 143us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938721.847549:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784938721.847627:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342513280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938721.848277:0:30652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:30652:1871643342513408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938721.848323:0:30652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938721.848389:0:30652:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747362b5240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938721.848423:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342513408 00000100:00100000:0.0:1784938721.848429:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342513408 00000100:00100000:0.0:1784938721.848503:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784938721.848511:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:30652:x1871643342513408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938721.848673:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:30652:x1871643342513408:12345-0@lo:502:llog_process_th.0 Request processed in 162us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938721.848679:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938721.848780:0:30652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:30652:1871643342513408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938721.848815:0:30652:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938721.848827:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938721.848829:0:30652:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784938721.848835:0:30652:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1784938721.848838:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784938721.848856:0:30652:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff974609e8b380) 00000020:00000080:3.0:1784938721.848875:0:30652:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1784938721.848881:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784938721.848942:0:30652:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784938721.848948:0:30652:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a06bf5 00000020:00000080:3.0:1784938721.849158:0:30652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784938721.849164:0:30652:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938721.849167:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938721.849169:0:30652:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784938721.849171:0:30652:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938721.849175:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938721.849176:0:30652:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1784938721.849179:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784938721.849187:0:30652:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff974609e88000) 00000020:00000080:3.0:1784938721.849197:0:30652:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1784938721.849202:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784938721.849204:0:30652:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1784938721.849208:0:30652:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1784938721.849216:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784938721.849271:0:30652:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9747294ad000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784938721.849284:0:30652:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff974609e8cd40) 00000020:00000080:3.0:1784938721.849293:0:30652:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1784938721.849338:0:30652:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784938721.849343:0:30652:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a06c0a 00000020:00000080:3.0:1784938721.849425:0:30652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784938721.849433:0:30652:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784938721.849438:0:30652:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcd9d312a94a06c11 00080000:01000000:3.0:1784938721.849442:0:30652:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784938721.849446:0:30652:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a06c18 00080000:10000000:3.0:1784938721.849859:0:30652:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1784938721.850074:0:30652:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1784938721.853566:0:30652:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1784938721.898423:0:30652:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1784938721.898905:0:30652:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1784938721.901057:0:30652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1784938721.901330:0:30652:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784938721.924290:0:30652:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9747366819c0) 00000020:00000080:2.0:1784938721.924315:0:30652:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784938721.924391:0:30652:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784938721.924399:0:30652:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a06c26 00000020:00000080:0.0:1784938721.928372:0:30652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1784938721.929747:0:30652:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784938721.958046:0:30652:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784938721.988280:0:30652:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784938722.024707:0:30652:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784938722.059650:0:30652:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784938722.079682:0:30652:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1784938722.106985:0:30652:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcd9d312a94a06c2d 00000020:00000080:0.0:1784938722.107338:0:30652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1784938722.107355:0:30652:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938722.107362:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938722.107364:0:30652:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1784938722.107368:0:30652:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938722.107374:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938722.107375:0:30652:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1784938722.107380:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1784938722.107420:0:30652:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1784938722.107435:0:30652:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938722.107438:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938722.107440:0:30652:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1784938722.107442:0:30652:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938722.107444:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938722.107446:0:30652:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784938722.107448:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784938722.107450:0:30652:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784938722.107498:0:30652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:30652:1871643342513536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938722.107575:0:30652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938722.107633:0:30652:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718548b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938722.107698:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342513536 00000100:00100000:2.0:1784938722.107706:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342513536 00000100:00100000:2.0:1784938722.107783:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784938722.107793:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:30652:x1871643342513536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938722.108207:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:30652:x1871643342513536:12345-0@lo:502:llog_process_th.0 Request processed in 415us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938722.108216:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784938722.108278:0:30652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:30652:1871643342513536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938722.108312:0:30652:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938722.108317:0:30652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938722.108319:0:30652:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784938722.108322:0:30652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1784938722.108548:0:30610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1784938722.108566:0:30610:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784938722.108591:0:30610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06be7 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.108603:0:30610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06be7 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938722.108611:0:30610:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9747294ad000 from 1 10000000:01000000:0.0:1784938722.108614:0:30610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938722.108643:0:30610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.108663:0:30610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.108673:0:30610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938722.108690:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342513664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938722.108723:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938722.108781:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747185486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938722.108849:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342513664 00000100:00100000:0.0:1784938722.108854:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342513664 00000100:00100000:0.0:1784938722.108880:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784938722.108886:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:30610:x1871643342513664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938722.108896:0:30625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938722.108911:0:30625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609396200/0xcd9d312a94a06c3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06c34 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.108931:0:30625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609396200/0xcd9d312a94a06c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06c34 expref: 10 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.108941:0:30625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609396200/0xcd9d312a94a06c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06c34 expref: 10 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.108950:0:30625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609396200, rc 0) 00000100:00100000:0.0:1784938722.108981:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:30610:x1871643342513664:12345-0@lo:101:mount.lustre.0 Request processed in 95us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938722.108987:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784938722.109030:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342513664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938722.109042:0:30610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c3b expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.109051:0:30610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06c3b expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938722.109573:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342513792:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1784938722.109607:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938722.109623:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747185486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938722.109639:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342513792 00000100:00100000:0.0:1784938722.109643:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342513792 00000100:00100000:0.0:1784938722.109663:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784938722.109668:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:30610:x1871643342513792:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1784938722.109681:0:30623:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784938722.109686:0:30623:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1784938722.109775:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:30610:x1871643342513792:12345-0@lo:256:mount.lustre.0 Request processed in 106us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938722.109781:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784938722.110138:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342513792:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1784938722.110743:0:30610:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784938722.110970:0:30610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c3b expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.110982:0:30610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c3b expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938722.111004:0:30610:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9747294ad000 from 1 10000000:01000000:0.0:1784938722.111006:0:30610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938722.111036:0:30610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.111044:0:30610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.111055:0:30610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938722.111073:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342513920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938722.111113:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938722.111152:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747185486c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938722.111219:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342513920 00000100:00100000:3.0:1784938722.111231:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342513920 00000100:00100000:3.0:1784938722.111273:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938722.111281:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:30610:x1871643342513920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938722.111291:0:30624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938722.111305:0:30624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974741e01e00/0xcd9d312a94a06c49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06c42 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938722.111323:0:30624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974741e01e00/0xcd9d312a94a06c49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06c42 expref: 11 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938722.111334:0:30624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974741e01e00/0xcd9d312a94a06c49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06c42 expref: 11 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938722.111343:0:30624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01e00, rc 0) 00000100:00100000:3.0:1784938722.111388:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30610:x1871643342513920:12345-0@lo:101:mount.lustre.0 Request processed in 108us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938722.111394:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784938722.111508:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342513920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938722.111521:0:30610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c49 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.111529:0:30610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06c49 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938722.111579:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342514048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938722.111605:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938722.111627:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff974706191240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938722.111678:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342514048 00000100:00100000:0.0:1784938722.111681:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342514048 00000100:00100000:0.0:1784938722.111709:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784938722.111716:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30610:x1871643342514048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938722.112323:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30610:x1871643342514048:12345-0@lo:501:mount.lustre.0 Request processed in 606us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938722.112330:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784938722.112491:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342514048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938722.112523:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342514176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938722.112559:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938722.112585:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff974706191240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938722.112643:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342514176 00000100:00100000:3.0:1784938722.112647:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342514176 00000100:00100000:3.0:1784938722.112713:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784938722.112721:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30610:x1871643342514176:12345-0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784938722.112783:0:30624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784938722.112879:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30610:x1871643342514176:12345-0@lo:503:mount.lustre.0 Request processed in 158us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938722.112886:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784938722.113054:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342514176:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784938722.114068:0:30656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1784938722.114221:0:30610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1784938722.114239:0:30610:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938722.114290:0:30610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c49 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.114300:0:30610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c49 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938722.114349:0:30610:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784938722.114352:0:30610:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9747294ad000 10000000:01000000:1.0:1784938722.114355:0:30610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9747294ad000 10000000:01000000:1.0:1784938722.114358:0:30610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938722.114364:0:30610:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9747294ad000 from 1 10000000:01000000:1.0:1784938722.114366:0:30610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938722.114395:0:30610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.114403:0:30610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.114413:0:30610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938722.114432:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342514304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938722.114478:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938722.114515:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff974706191900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938722.114569:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342514304 00000100:00100000:0.0:1784938722.114576:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342514304 00000100:00100000:0.0:1784938722.114647:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784938722.114656:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30610:x1871643342514304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938722.114667:0:30625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938722.114680:0:30625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609397200/0xcd9d312a94a06c57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06c50 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.114708:0:30625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609397200/0xcd9d312a94a06c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06c50 expref: 12 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.114718:0:30625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609397200/0xcd9d312a94a06c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06c50 expref: 12 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.114726:0:30625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609397200, rc 0) 00000100:00100000:1.0:1784938722.114894:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342514304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938722.114908:0:30610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c57 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.114917:0:30610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06c57 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938722.114963:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342514432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938722.114987:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938722.115014:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30610:x1871643342514304:12345-0@lo:101:mount.lustre.0 Request processed in 359us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938722.115021:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784938722.115149:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff974706191900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938722.115225:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342514432 00000100:00100000:0.0:1784938722.115229:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342514432 00000100:00100000:0.0:1784938722.115245:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784938722.115251:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30610:x1871643342514432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938722.115495:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30610:x1871643342514432:12345-0@lo:501:mount.lustre.0 Request processed in 243us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938722.115503:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784938722.115571:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342514432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938722.115601:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342514560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938722.115639:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938722.115661:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff974706191900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938722.115709:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342514560 00000100:00100000:0.0:1784938722.115713:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342514560 00000100:00100000:0.0:1784938722.115742:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784938722.115749:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30610:x1871643342514560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938722.116134:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30610:x1871643342514560:12345-0@lo:503:mount.lustre.0 Request processed in 384us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938722.116141:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784938722.116224:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342514560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938722.116653:0:30657:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:30657:1871643342514688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938722.116687:0:30657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938722.116715:0:30657:0:(client.c:2702:ptlrpc_set_wait()) set ffff974706191480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938722.116786:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342514688 00000100:00100000:0.0:1784938722.116791:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342514688 00000100:00100000:0.0:1784938722.116939:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784938722.116947:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30657:x1871643342514688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938722.117231:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30657:x1871643342514688:12345-0@lo:502:llog_process_th.0 Request processed in 284us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938722.117238:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784938722.117340:0:30657:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:30657:1871643342514688:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1784938722.117397:0:30657:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784938722.117414:0:30657:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9747034acd40) 00000020:00000080:1.0:1784938722.117432:0:30657:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1784938722.117636:0:30657:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9747294ad000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784938722.117640:0:30657:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9747294ad000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784938722.117643:0:30657:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9747294ad000 4 00010000:00080000:1.0:1784938722.117675:0:30657:0:(ldlm_lib.c:125:import_set_conn()) imp ffff974601dd3000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:0.0:1784938722.119686:0:30657:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1784938722.121023:0:30657:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784938722.121061:0:30657:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784938722.121073:0:30657:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcd9d312a94a06c65 00000100:00080000:0.0:1784938722.121086:0:30657:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 192.168.202.104@tcp last attempt 0 00000100:00080000:0.0:1784938722.121096:0:30657:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff974601dd3000 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:0.0:1784938722.121131:0:30657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97473a634e00 x1871643342514816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938722.121213:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342514816:192.168.202.104@tcp:38:llog_process_th.0 00000100:00080000:0.0:1784938722.121887:0:30657:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784938722.123078:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938722.123118:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342514816 00000100:00100000:2.0:1784938722.123127:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342514816 00000100:00100000:2.0:1784938722.123160:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:2.0:1784938722.123167:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:12801:x1871643342514816:12345-192.168.202.104@tcp:38:llog_process_th.0 00000100:00100000:2.0:1784938722.123234:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:12801:x1871643342514816:12345-192.168.202.104@tcp:38:llog_process_th.0 Request processed in 66us (162us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784938722.123241:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:2.0:1784938722.123360:0:30657:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:30657:1871643342514944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938722.123410:0:30657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938722.123443:0:30657:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746032a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938722.123560:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342514944 00000100:00100000:3.0:1784938722.123565:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342514944 00000100:00100000:3.0:1784938722.123598:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784938722.123611:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30657:x1871643342514944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938722.125606:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30657:x1871643342514944:12345-0@lo:502:llog_process_th.0 Request processed in 1988us (2188us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938722.125619:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784938722.126091:0:30657:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:30657:1871643342514944:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784938722.126129:0:30657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1784938722.126540:0:12801:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784938722.126548:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974601dd3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938722.126554:0:12801:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.104@tcp failed (-11) 00000100:00100000:3.0:1784938722.126557:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342514816:192.168.202.104@tcp:38:llog_process_th.0 00000020:01000000:0.0:1784938722.126596:0:30610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1784938722.126615:0:30610:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938722.126662:0:30610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c57 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938722.126673:0:30610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c57 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784938722.126720:0:30610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784938722.126723:0:30610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938722.126724:0:30610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938722.126725:0:30610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938722.126727:0:30610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938722.126728:0:30610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938722.126741:0:30610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938722.126748:0:30610:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938722.126775:0:30610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784938722.126777:0:30610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784938722.126778:0:30610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938722.126780:0:30610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938722.126783:0:30610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1784938722.126786:0:30610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784938722.126787:0:30610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938722.126788:0:30610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938722.126789:0:30610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938722.126789:0:30610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938722.126790:0:30610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938722.126791:0:30610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938722.126792:0:30610:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938722.126793:0:30610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784938722.126895:0:30610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784938722.126898:0:30610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938722.126898:0:30610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938722.126922:0:30610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784938722.126939:0:30610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342515072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784938722.126982:0:30610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938722.127018:0:30610:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474214e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938722.127903:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342515072 00000100:00100000:3.0:1784938722.127913:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342515072 00000100:00100000:3.0:1784938722.127968:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784938722.127977:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30610:x1871643342515072:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784938722.128004:0:30623:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784938722.128018:0:30623:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784938722.158618:0:30623:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784938722.158640:0:30623:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784938722.158777:0:30646:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784938722.158782:0:30646:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784938722.158814:0:30646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938722.158833:0:30646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974609396200/0xcd9d312a94a06c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06c34 expref: 12 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938722.158854:0:30646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938722.158892:0:30646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974609396200/0xcd9d312a94a06c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06c34 expref: 12 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938722.158907:0:30646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974609396200/0xcd9d312a94a06c3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06c34 expref: 12 pid: 30625 timeout: 975 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938722.158923:0:30646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:30646:1871643342515200:0@lo:104: 00000100:00100000:2.0:1784938722.158987:0:30646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938722.159032:0:30646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746032a8300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938722.159178:0:30613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342515200 00000100:00100000:1.0:1784938722.159186:0:30613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342515200 00000100:00100000:1.0:1784938722.159240:0:30613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784938722.159250:0:30613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30646:x1871643342515200:12345-0@lo:104: 00010000:00010000:1.0:1784938722.159262:0:30613:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06c3b expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159319:0:30613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784938722.159332:0:30613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30646:x1871643342515200:12345-0@lo:104: Request processed in 84us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938722.159339:0:30613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1784938722.159359:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938722.159365:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06c3b expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159372:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396a00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:1.0:1784938722.159376:0:30619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06c3b expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159384:0:30619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06c3b expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938722.159391:0:30619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06c3b expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938722.159397:0:30619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938722.159422:0:30619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c3b expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159428:0:30619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938722.159446:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c3b expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159452:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609396a00/0xcd9d312a94a06c34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c3b expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159468:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938722.159470:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938722.159472:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938722.159496:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342515328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938722.159523:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938722.159577:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342515328 00000100:00100000:1.0:1784938722.159581:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342515328 00010000:00010000:1.0:1784938722.159596:0:30615:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974609396200/0xcd9d312a94a06c3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06c34 expref: 13 pid: 30625 timeout: 975 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938722.159617:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784938722.159623:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:12803:x1871643342515328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938722.159632:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938722.159637:0:30615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974609396200/0xcd9d312a94a06c3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06c34 expref: 13 pid: 30625 timeout: 975 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159645:0:30615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974609396200/0xcd9d312a94a06c3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06c34 expref: 13 pid: 30625 timeout: 975 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159660:0:30615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159668:0:30615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938722.159679:0:30615:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000897789s 00010000:00010000:1.0:1784938722.159684:0:30615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159691:0:30615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159697:0:30615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159714:0:30615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159720:0:30615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938722.159724:0:30615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159743:0:30615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159781:0:30615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159791:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938722.159831:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:12803:x1871643342515328:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938722.159838:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784938722.159878:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342515328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938722.159907:0:30646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609396200/0xcd9d312a94a06c3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06c34 expref: 12 pid: 30625 timeout: 975 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938722.159916:0:30646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:30646:1871643342515200:0@lo:104: 00010000:00010000:1.0:1784938722.159931:0:30646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159939:0:30646:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159955:0:30646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938722.159961:0:30646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924f800/0xcd9d312a94a06c6c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938722.167656:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30610:x1871643342515072:12345-0@lo:253:mount.lustre.0 Request processed in 39670us (40664us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938722.167670:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784938722.167877:0:30610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:30610:1871643342515072:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784938722.167896:0:30610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784938722.167899:0:30610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784938722.167901:0:30610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784938722.167903:0:30610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938722.167904:0:30610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938722.167905:0:30610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938722.167906:0:30610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938722.167908:0:30610:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784938722.167909:0:30610:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784938722.167911:0:30610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784938722.167912:0:30610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784938722.167913:0:30610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938722.167914:0:30610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784938722.167930:0:30610:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784938722.172639:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938722.173100:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784938722.173280:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938722.174935:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784938722.175137:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938722.175284:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1784938722.176083:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1784938722.176260:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1784938722.176465:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1784938722.176655:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1784938722.177118:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1784938722.177288:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1784938722.221685:0:30610:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1784938722.255370:0:30610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784938722.255542:0:30662:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1784938722.255546:0:30662:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1784938722.255702:0:30663:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1784938722.259002:0:30610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1784938722.259254:0:30610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1784938722.259700:0:30610:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784938722.259707:0:30610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784938722.260190:0:30610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938722.261339:0:30610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784938722.262151:0:30610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784938722.262190:0:30610:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784938722.262441:0:30610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1784938722.262633:0:30610:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1784938722.264618:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1784938722.264971:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1784938722.265123:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1784938722.265280:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1784938722.265411:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1784938722.265564:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1784938722.265725:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1784938722.266173:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1784938722.266304:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1784938722.266459:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1784938722.266593:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1784938722.268987:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1784938722.269367:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1784938722.269536:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1784938722.269673:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1784938722.270501:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1784938722.270830:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1784938722.271022:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1784938722.271391:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1784938722.271544:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1784938722.271677:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1784938722.271942:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1784938722.272141:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1784938722.272293:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1784938722.272423:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1784938722.272574:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1784938722.272709:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1784938722.273253:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1784938722.273398:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1784938722.273565:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1784938722.273694:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1784938722.273985:0:30610:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1784938722.274283:0:30610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1784938722.310239:0:30663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1784938722.359445:0:30610:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784938722.359479:0:30610:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa2eec1543988 00100000:10000000:3.0:1784938722.359487:0:30610:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1784938722.365566:0:30610:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784938722.365584:0:30610:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784938722.365597:0:30610:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784938722.365615:0:30610:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1784938722.419253:0:30663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784938722.419436:0:30663:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784938722.419441:0:30663:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1784938722.631869:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784938723.122995:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784938723.123004:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9747294ad000 from 3 10000000:01000000:1.0:1784938723.123010:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938723.123064:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938723.123076:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938723.123090:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938723.123971:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342515456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938723.124062:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938723.124135:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747409d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938723.124450:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342515456 00000100:00100000:0.0:1784938723.124466:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342515456 00000100:00100000:0.0:1784938723.124525:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784938723.124534:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30627:x1871643342515456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938723.124550:0:30625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938723.124568:0:30625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609397400/0xcd9d312a94a06c7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06c73 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938723.124593:0:30625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609397400/0xcd9d312a94a06c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06c73 expref: 12 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938723.124605:0:30625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609397400/0xcd9d312a94a06c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06c73 expref: 12 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938723.124616:0:30625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609397400, rc 0) 00000100:00100000:0.0:1784938723.124669:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342515456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938723.124677:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784938723.124807:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342515456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938723.124833:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c7a expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938723.124842:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06c7a expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938723.125023:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342515584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784938723.125058:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938723.125076:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746032a8480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938723.125398:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342515584 00000100:00100000:1.0:1784938723.125403:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342515584 00000100:00100000:1.0:1784938723.125429:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784938723.125436:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342515584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784938723.125453:0:30624:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784938723.125470:0:30624:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784938723.125473:0:30624:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1784938723.125554:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342515584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938723.125567:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784938723.126034:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342515584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784938723.126084:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784938723.126092:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c7a expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938723.126101:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c7a expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938723.635462:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938724.659872:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938725.683120:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938726.718660:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938727.285198:0:12700:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784938727.285206:0:12700:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784938727.285209:0:12700:0:(import.c:65:import_set_state_nolock()) ffff974601dd3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938727.285238:0:12700:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff974601dd3000 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:3.0:1784938727.285265:0:12700:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97472fc88700 x1871643342515840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938727.288866:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342515712:0@lo:400:kworker.0 00000100:00100000:0.0:1784938727.288947:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938727.291652:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342515712 00000100:00100000:2.0:1784938727.292037:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342515712 00000100:00100000:2.0:1784938727.292110:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784938727.292120:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:12804:x1871643342515712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938727.292213:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:12804:x1871643342515712:12345-0@lo:400:kworker.0 Request processed in 95us (3266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938727.292221:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784938727.295222:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342515712:0@lo:400:kworker.0 00000100:00100000:3.0:1784938727.296119:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342515840:192.168.202.104@tcp:38:kworker.0 00000100:00100000:1.0:1784938727.300089:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938727.300219:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342515840 00000100:00100000:2.0:1784938727.300230:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342515840 00000100:00100000:2.0:1784938727.300277:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:2.0:1784938727.300296:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:12801:x1871643342515840:12345-192.168.202.104@tcp:38:kworker.0 00010000:00080000:2.0:1784938727.300331:0:30632:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 881 last 0 00000020:00000080:2.0:1784938727.300378:0:30632:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcd9d312a94a06c81 00000004:00100000:2.0:1784938727.300391:0:30632:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938727.300534:0:30632:0:(import.c:65:import_set_state_nolock()) ffff974609e42000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938727.300601:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12801:x1871643342515840:12345-192.168.202.104@tcp:38:kworker.0 Request processed in 304us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938727.300609:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 1 00010000:00080000:3.0:1784938727.301077:0:12801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97472fc88700 x1871643342515840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938727.301095:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784938727.301103:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784938727.301109:0:12801:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784938727.301112:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974601dd3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784938727.301118:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342515840:192.168.202.104@tcp:38:kworker.0 00010000:00010000:3.0:1784938727.730948:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784938727.736003:0:30906:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784938728.766541:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938729.791227:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938730.803735:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938731.827209:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938732.403399:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938732.403423:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342515968:0@lo:400:kworker.0 00000100:00100000:0.0:1784938732.403504:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938732.403578:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342516096:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938732.403677:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342515968 00000100:00100000:0.0:1784938732.403689:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342515968 00000100:00100000:0.0:1784938732.403736:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784938732.403745:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:12804:x1871643342515968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938732.404303:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:12804:x1871643342515968:12345-0@lo:400:kworker.0 Request processed in 557us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938732.404311:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784938732.404544:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938732.406288:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342516096 00000100:00100000:2.0:1784938732.406301:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342516096 00000100:00100000:2.0:1784938732.406355:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:2.0:1784938732.406453:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342516096:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938732.413796:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342516096:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 7331us (9238us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938732.413813:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 0 00010000:00080000:0.0:1784938732.415685:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97473a634e00 x1871643342516096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938732.415706:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342516096:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938732.417118:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342515968:0@lo:400:kworker.0 00010000:00010000:3.0:1784938732.852158:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784938733.740989:0:31108:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff76b4ab80 20000000:00000080:3.0:1784938733.741017:0:31108:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97471d99fc00 uarg=0000000000000000 20000000:01000000:3.0:1784938733.741061:0:31108:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1784938733.741070:0:31108:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1784938733.741077:0:31108:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1784938733.741316:0:31108:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1784938733.741329:0:31108:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1784938733.752296:0:31108:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938733.752533:0:31108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1784938733.752588:0:31108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1784938733.752649:0:31108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1784938733.752669:0:31108:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784938733.753327:0:31108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938733.753351:0:31108:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974741e01e00/0xcd9d312a94a06c49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06c42 expref: 11 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938733.753360:0:31108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938733.753407:0:31108:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974741e01e00/0xcd9d312a94a06c49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06c42 expref: 11 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938733.753440:0:31108:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974741e01e00/0xcd9d312a94a06c49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06c42 expref: 11 pid: 30624 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938733.753454:0:31108:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a636300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:31108:1871643342516224:0@lo:104: 00000100:00100000:0.0:1784938733.753523:0:31108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938733.753586:0:31108:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938733.753659:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342516224 00000100:00100000:2.0:1784938733.753668:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342516224 00000100:00100000:2.0:1784938733.753720:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784938733.753730:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:31108:x1871643342516224:12345-0@lo:104: 00010000:00010000:2.0:1784938733.753745:0:30614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06c49 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938733.753851:0:30614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938733.753865:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:31108:x1871643342516224:12345-0@lo:104: Request processed in 137us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938733.753872:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1784938733.753902:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938733.753911:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06c49 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938733.753919:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396e00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938733.753931:0:30619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06c49 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938733.753941:0:30619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06c49 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938733.753949:0:30619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06c49 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938733.753955:0:30619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938733.754000:0:30619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c49 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938733.754007:0:30619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938733.754034:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c49 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938733.754037:0:31108:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a636300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:31108:1871643342516224:0@lo:104: 00010000:00010000:3.0:1784938733.754048:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609396e00/0xcd9d312a94a06c42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c49 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938733.754071:0:31108:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938733.754072:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938733.754076:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938733.754080:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938733.754095:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342516352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938733.754129:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938733.754193:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342516352 00000100:00100000:1.0:1784938733.754198:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342516352 00010000:00010000:1.0:1784938733.754219:0:30615:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974741e01e00/0xcd9d312a94a06c49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06c42 expref: 12 pid: 30624 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938733.754255:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784938733.754263:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:12803:x1871643342516352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938733.754273:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938733.754279:0:30615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974741e01e00/0xcd9d312a94a06c49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06c42 expref: 12 pid: 30624 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938733.754290:0:30615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974741e01e00/0xcd9d312a94a06c49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06c42 expref: 12 pid: 30624 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938733.754305:0:30615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974741e01e00/0xcd9d312a94a06c49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06c42 expref: 12 pid: 30624 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938733.754329:0:30615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938733.754337:0:30615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938733.754349:0:30615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938733.754356:0:30615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938733.754363:0:30615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938733.754369:0:30615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938733.754374:0:30615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938733.754378:0:30615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938733.754385:0:30615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938733.754406:0:30615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938733.754417:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938733.754428:0:31108:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938733.754439:0:31108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938733.754447:0:31108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609396600/0xcd9d312a94a06c88 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938733.754459:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:12803:x1871643342516352:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938733.754473:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784938733.760067:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342516352:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938733.884042:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938734.898943:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784938735.039895:0:30627:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784938735.039904:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9747294ad000 from 1 10000000:01000000:1.0:1784938735.039910:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938735.040495:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938735.040509:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938735.040522:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938735.040548:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342516480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938735.040610:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938735.040678:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747409d6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938735.041795:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342516480 00000100:00100000:1.0:1784938735.041805:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342516480 00000100:00100000:1.0:1784938735.041863:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784938735.041871:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30627:x1871643342516480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938735.041886:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938735.041902:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974735f29e00/0xcd9d312a94a06c96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06c8f expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938735.041928:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974735f29e00/0xcd9d312a94a06c96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06c8f expref: 12 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938735.041939:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974735f29e00/0xcd9d312a94a06c96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06c8f expref: 12 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938735.041976:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29e00, rc 0) 00000100:00100000:1.0:1784938735.042026:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342516480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938735.042033:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784938735.042083:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342516480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938735.042100:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c96 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938735.042110:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06c96 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938735.042167:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342516608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938735.042193:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938735.042217:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747409d6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938735.042227:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342516608 00000100:00100000:1.0:1784938735.042230:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342516608 00000100:00100000:1.0:1784938735.042248:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784938735.042253:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342516608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938735.042485:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342516608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938735.042492:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784938735.042517:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342516608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938735.042542:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342516736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938735.042573:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938735.042589:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747409d6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938735.042599:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342516736 00000100:00100000:1.0:1784938735.042602:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342516736 00000100:00100000:1.0:1784938735.042618:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784938735.042622:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342516736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938735.042789:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342516736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938735.042797:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784938735.042835:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342516736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938735.043037:0:31168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:31168:1871643342516864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938735.043073:0:31168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938735.043091:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342516864 00000100:00100000:1.0:1784938735.043094:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342516864 00000100:00100000:1.0:1784938735.043115:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784938735.043121:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31168:x1871643342516864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938735.043235:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31168:x1871643342516864:12345-0@lo:502:llog_process_th.0 Request processed in 113us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938735.043241:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784938735.043278:0:31168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747409d6540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938735.043291:0:31168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:31168:1871643342516864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938735.043312:0:31168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938735.043322:0:31168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938735.043325:0:31168:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784938735.043334:0:31168:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9747294ad000 00000020:00000080:1.0:1784938735.043336:0:31168:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784938735.043358:0:31168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:31168:1871643342516992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938735.043396:0:31168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938735.043413:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342516992 00000100:00100000:1.0:1784938735.043417:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342516992 00000100:00100000:1.0:1784938735.043436:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784938735.043441:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31168:x1871643342516992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938735.043528:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31168:x1871643342516992:12345-0@lo:502:llog_process_th.0 Request processed in 85us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938735.043535:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784938735.043564:0:31168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747409d6540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938735.043576:0:31168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:31168:1871643342516992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938735.043593:0:31168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938735.043597:0:31168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938735.043599:0:31168:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784938735.043603:0:31168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1784938735.050329:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784938735.050361:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938735.050373:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c96 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938735.050387:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06c96 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938735.923368:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938736.947329:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938737.527703:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342517248:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938737.527873:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938737.527882:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342517120:0@lo:400:kworker.0 00000100:00100000:1.0:1784938737.527936:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938737.528159:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938737.528196:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342517248 00000100:00100000:3.0:1784938737.528203:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342517248 00000100:00100000:3.0:1784938737.528259:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:3.0:1784938737.528269:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342517248:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938737.528329:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342517248:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 61us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938737.528337:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 1 00010000:00080000:1.0:1784938737.528584:0:12805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97472fc89f80 x1871643342517248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938737.528617:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342517248:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938737.531037:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342517120 00000100:00100000:2.0:1784938737.531050:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342517120 00000100:00100000:0.0:1784938737.531188:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784938737.531200:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:12805:x1871643342517120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938737.531293:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:12805:x1871643342517120:12345-0@lo:400:kworker.0 Request processed in 95us (3357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938737.531300:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784938737.531449:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342517120:0@lo:400:kworker.0 00010000:00010000:1.0:1784938737.973275:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938738.998845:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784938739.501800:0:31422:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:2.0:1784938739.501805:0:31422:0:(obd_mount.c:922:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1784938739.501921:0:31422:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff974603c37000 00000020:01000004:2.0:1784938739.501938:0:31422:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1784938739.501948:0:31422:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1784938739.501963:0:31422:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff974736683380) 00000020:00000080:2.0:1784938739.501982:0:31422:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1784938739.527466:0:31422:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1784938739.527769:0:31422:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1784938739.706105:0:31422:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784938739.710979:0:31422:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784938739.711015:0:31422:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784938739.711229:0:31422:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784938739.711369:0:31422:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784938739.714771:0:31422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784938739.714788:0:31422:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784938739.714810:0:31422:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd9d312a94a06ca4 00000020:01000004:2.0:1784938739.714819:0:31422:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1784938739.714860:0:31422:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784938739.714864:0:31422:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784938739.714870:0:31422:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784938739.714887:0:31422:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784938739.714901:0:31422:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff974736684d40) 00000020:00000080:2.0:1784938739.714915:0:31422:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1784938739.717197:0:31422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938739.717367:0:31422:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784938739.717374:0:31422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1784938739.722784:0:31422:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1784938739.722801:0:31422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1784938739.728202:0:31422:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1784938739.728215:0:31422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1784938739.730104:0:31422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938739.730302:0:31422:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1784938739.730310:0:31422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1784938739.735020:0:31422:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1784938739.735042:0:31422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1784938739.763223:0:31422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938739.763434:0:31422:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784938739.763441:0:31422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1784938739.764585:0:31422:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784938739.764603:0:31422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1784938739.765427:0:31422:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784938739.765435:0:31422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1784938739.768331:0:31422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938739.768512:0:31422:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1784938739.768519:0:31422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1784938739.772052:0:31422:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1784938739.772067:0:31422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1784938739.827965:0:31422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938739.828180:0:31422:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1784938739.828190:0:31422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1784938739.829445:0:31422:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1784938739.829454:0:31422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1784938739.830114:0:31422:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1784938739.830137:0:31422:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1784938739.830143:0:31422:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1784938739.997043:0:31422:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784938739.997078:0:31422:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1784938739.997083:0:31422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784938739.997085:0:31422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784938739.997086:0:31422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938739.997087:0:31422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938739.997088:0:31422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938739.997089:0:31422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938739.997091:0:31422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938739.997093:0:31422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784938739.997094:0:31422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784938739.997096:0:31422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938739.997097:0:31422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784938739.997101:0:31422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1784938739.997103:0:31422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784938739.997108:0:31422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784938739.997109:0:31422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938739.997110:0:31422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938739.997111:0:31422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938739.997112:0:31422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938739.997113:0:31422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938739.997114:0:31422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784938739.997115:0:31422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784938739.997116:0:31422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938739.997117:0:31422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784938739.997143:0:31422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784938739.997161:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342517376:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784938739.997229:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938739.997280:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460272c840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938739.997386:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342517376 00000100:00100000:3.0:1784938739.997394:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342517376 00000100:00100000:3.0:1784938739.997490:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784938739.997500:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342517376:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784938739.997531:0:30624:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784938739.997535:0:30624:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1784938739.997541:0:30624:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1784938739.997544:0:30624:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1784938739.998432:0:30624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938739.998643:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1784938739.998657:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1784938739.998695:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1784938739.998702:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1784938739.998733:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1784938739.998817:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1784938739.999174:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1784938739.999193:0:30624:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.104@tcp 20000000:01000000:3.0:1784938739.999195:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:3.0:1784938739.999246:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1784938739.999263:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784938739.999315:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1784938739.999323:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:3.0:1784938739.999356:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1784938739.999365:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784938739.999395:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1784938739.999445:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1784938740.000155:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1784938740.000172:0:30624:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.104@tcp 20000000:01000000:3.0:1784938740.000174:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:3.0:1784938740.000208:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1784938740.000216:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784938740.000247:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1784938740.000254:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:3.0:1784938740.000299:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1784938740.000309:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784938740.000342:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1784938740.000379:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1784938740.000395:0:30624:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784938740.000398:0:30624:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784938740.000401:0:30624:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784938740.000415:0:30624:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784938740.000418:0:30624:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1784938740.000448:0:30624:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784938740.000451:0:30624:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784938740.001346:0:31438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1784938740.001405:0:31438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1784938740.001453:0:31438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1784938740.001906:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1784938740.001953:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1784938740.002011:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1784938740.002025:0:30624:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784938740.002027:0:30624:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784938740.002437:0:31439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1784938740.002482:0:31439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1784938740.002532:0:31439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1784938740.002856:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1784938740.002898:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1784938740.002933:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1784938740.002947:0:30624:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784938740.002956:0:30624:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784938740.003282:0:31440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1784938740.003731:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1784938740.003889:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1784938740.003953:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1784938740.003970:0:30624:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1784938740.003973:0:30624:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1784938740.003982:0:30624:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784938740.004004:0:30624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.004023:0:30624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974735f28c00/0xcd9d312a94a06bcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06bc4 expref: 12 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.004031:0:30624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97460924e400/0xcd9d312a94a06be7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06be0 expref: 12 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.004039:0:30624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974609397200/0xcd9d312a94a06c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06c50 expref: 12 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.004048:0:30624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.004089:0:30624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974609397200/0xcd9d312a94a06c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06c50 expref: 12 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.004101:0:30624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974609397200/0xcd9d312a94a06c57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06c50 expref: 12 pid: 30625 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938740.004113:0:30624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342517504:0@lo:104: 00000100:00100000:0.0:1784938740.004168:0:30624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938740.004250:0:30624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97460924e400/0xcd9d312a94a06be7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06be0 expref: 12 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.004270:0:30624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97460924e400/0xcd9d312a94a06be7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06be0 expref: 12 pid: 30623 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938740.004279:0:30624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342517632:0@lo:104: 00000100:00100000:0.0:1784938740.004301:0:30624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938740.004357:0:30624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974735f28c00/0xcd9d312a94a06bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06bc4 expref: 12 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.004363:0:30624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974735f28c00/0xcd9d312a94a06bcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06bc4 expref: 12 pid: 30623 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938740.004368:0:30624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342517760:0@lo:104: 00000100:00100000:0.0:1784938740.004380:0:30624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938740.004428:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342517504 00000100:00100000:2.0:1784938740.004435:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342517504 00000100:00100000:2.0:1784938740.004469:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342517632 00000100:00100000:2.0:1784938740.004472:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342517632 00000100:00100000:2.0:1784938740.004487:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784938740.004495:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+4:30624:x1871643342517504:12345-0@lo:104: 00010000:00010000:2.0:1784938740.004507:0:30614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06c57 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.004558:0:30614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938740.004564:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+4:30624:x1871643342517504:12345-0@lo:104: Request processed in 70us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938740.004571:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784938740.004598:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784938740.004604:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30624:x1871643342517632:12345-0@lo:104: 00010000:00010000:2.0:1784938740.004612:0:30614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06be7 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.004645:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938740.004652:0:30614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1784938740.004656:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06c57 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938740.004660:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30624:x1871643342517632:12345-0@lo:104: Request processed in 55us (356us total) trans 0 rc 0/0 00010000:00010000:3.0:1784938740.004667:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28e00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938740.004673:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06c57 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938740.004677:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1784938740.004688:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06c57 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938740.004695:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06c57 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938740.004701:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938740.004710:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938740.004737:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c57 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.004744:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938740.004786:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c57 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.004794:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974735f28e00/0xcd9d312a94a06c50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c57 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.004808:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938740.004810:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938740.004812:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938740.004836:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342517888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938740.004872:0:12802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938740.004942:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342517888 00000100:00100000:3.0:1784938740.004947:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342517888 00010000:00010000:3.0:1784938740.004967:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974609397200/0xcd9d312a94a06c57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06c50 expref: 13 pid: 30625 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938740.004997:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784938740.005004:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:12802:x1871643342517888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938740.005015:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938740.005020:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974609397200/0xcd9d312a94a06c57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06c50 expref: 13 pid: 30625 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.005030:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974609397200/0xcd9d312a94a06c57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06c50 expref: 13 pid: 30625 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.005045:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938740.005088:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:12802:x1871643342517888:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938740.005095:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784938740.005128:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342517888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938740.005181:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938740.005188:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06be7 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.005195:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397c00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938740.005198:0:30619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06be7 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.005494:0:30619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06be7 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938740.005513:0:30619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06be7 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938740.005518:0:30619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938740.005540:0:30619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06be7 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.005546:0:30619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938740.005557:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06be7 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.005564:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609397c00/0xcd9d312a94a06be0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06be7 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.005572:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938740.005574:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938740.005575:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938740.005603:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342518016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938740.005635:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938740.005669:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342518016 00000100:00100000:3.0:1784938740.005674:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342518016 00010000:00010000:3.0:1784938740.005690:0:30615:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97460924e400/0xcd9d312a94a06be7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06be0 expref: 13 pid: 30623 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938740.005713:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784938740.005719:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:12803:x1871643342518016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938740.005739:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938740.005744:0:30615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97460924e400/0xcd9d312a94a06be7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06be0 expref: 13 pid: 30623 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.005790:0:30615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97460924e400/0xcd9d312a94a06be7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06be0 expref: 13 pid: 30623 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.005801:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938740.005828:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:12803:x1871643342518016:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938740.005835:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1784938740.005854:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938740.005857:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938740.005883:0:30624:0:(client.c:2702:ptlrpc_set_wait()) set ffff974740de0180 going to sleep for 11 seconds 00010000:00010000:0.0:1784938740.005899:0:30624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609397200/0xcd9d312a94a06c57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06c50 expref: 12 pid: 30625 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938740.005910:0:30624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342517504:0@lo:104: 00000100:00100000:2.0:1784938740.005931:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342518016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938740.005931:0:30624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924e400/0xcd9d312a94a06be7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06be0 expref: 11 pid: 30623 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938740.005939:0:30624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342517632:0@lo:104: 00000100:00100000:2.0:1784938740.005950:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342517760 00000100:00100000:2.0:1784938740.005953:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342517760 00000100:00100000:2.0:1784938740.005970:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784938740.005975:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30624:x1871643342517760:12345-0@lo:104: 00010000:00010000:2.0:1784938740.005984:0:30614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06bcb expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.006065:0:30614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938740.006071:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30624:x1871643342517760:12345-0@lo:104: Request processed in 96us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938740.006078:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1784938740.006078:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938740.006083:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06bcb expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.006090:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397800 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:1.0:1784938740.006093:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06bcb expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.006101:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06bcb expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938740.006107:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06bcb expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938740.006113:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938740.006142:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06bcb expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.006149:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938740.006167:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06bcb expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938740.006179:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342518144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938740.006183:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609397800/0xcd9d312a94a06bc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06bcb expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.006200:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938740.006203:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938740.006205:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938740.006213:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938740.006267:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342518144 00000100:00100000:1.0:1784938740.006271:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342518144 00010000:00010000:1.0:1784938740.006290:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974735f28c00/0xcd9d312a94a06bcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06bc4 expref: 11 pid: 30623 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938740.006312:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784938740.006318:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:12804:x1871643342518144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938740.006327:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938740.006332:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974735f28c00/0xcd9d312a94a06bcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06bc4 expref: 11 pid: 30623 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.006342:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974735f28c00/0xcd9d312a94a06bcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06bc4 expref: 11 pid: 30623 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.006355:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.006364:0:30616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.006377:0:30616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.006395:0:30616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.006401:0:30616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.006408:0:30616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.006413:0:30616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938740.006857:0:30624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974735f28c00/0xcd9d312a94a06bcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06bc4 expref: 11 pid: 30623 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938740.006868:0:30624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342517760:0@lo:104: 00010000:00010000:0.0:1784938740.006889:0:30624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.006905:0:30624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.006912:0:30624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784938740.006919:0:30624:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1784938740.006998:0:30616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.007007:0:30616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.007018:0:30616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.007025:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609396e00/0xcd9d312a94a06cb2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.007038:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938740.007076:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:12804:x1871643342518144:12345-0@lo:103:ldlm_bl.0 Request processed in 758us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938740.007084:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784938740.007350:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342518144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938740.019593:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938740.047047:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:31422:x1871643342517376:12345-0@lo:253:mount.lustre.0 Request processed in 49540us (49809us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938740.047064:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784938740.047174:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342517376:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784938740.047189:0:31422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784938740.047193:0:31422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784938740.047195:0:31422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784938740.047197:0:31422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938740.047198:0:31422:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1784938740.047200:0:31422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938740.047201:0:31422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938740.047203:0:31422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938740.047205:0:31422:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784938740.047206:0:31422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938740.047208:0:31422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784938740.047227:0:31422:0:(tgt_mount.c:101:server_register_mount()) register mount ffff974603c37000 from lustre-OST0000 10000000:01000000:2.0:1784938740.047254:0:31422:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1784938740.047257:0:31422:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1784938740.047264:0:31422:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97473bae19c0 local copy 10000000:01000000:2.0:1784938740.047281:0:31422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784938740.047318:0:31422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.047328:0:31422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.047336:0:31422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938740.047356:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342518272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784938740.047402:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938740.047437:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bc180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938740.047494:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342518272 00000100:00100000:0.0:1784938740.047500:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342518272 00000100:00100000:0.0:1784938740.047553:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784938740.047561:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:31422:x1871643342518272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938740.047574:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938740.047599:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609397200/0xcd9d312a94a06cc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06cb9 expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.047622:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609397200/0xcd9d312a94a06cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06cb9 expref: 10 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.047631:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609397200/0xcd9d312a94a06cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06cb9 expref: 10 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.047640:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609397200, rc 0) 00000100:00100000:0.0:1784938740.047673:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:31422:x1871643342518272:12345-0@lo:101:mount.lustre.0 Request processed in 113us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938740.047678:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784938740.047820:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342518272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938740.047833:0:31422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcd9d312a94a06cc0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.047842:0:31422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd9d312a94a06cc0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938740.048142:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342518400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938740.048168:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938740.048197:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938740.048399:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342518400 00000100:00100000:2.0:1784938740.048404:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342518400 00000100:00100000:2.0:1784938740.048442:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784938740.048450:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:31422:x1871643342518400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938740.048647:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:31422:x1871643342518400:12345-0@lo:501:mount.lustre.0 Request processed in 198us (478us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938740.048655:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784938740.048796:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342518400:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784938740.048810:0:31422:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784938740.048930:0:31422:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784938740.048936:0:31422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd9d312a94a06cc0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.048945:0:31422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd9d312a94a06cc0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.048952:0:31422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd9d312a94a06cc0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.048978:0:31422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784938740.048997:0:31422:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff974603c37000 10000000:01000000:3.0:1784938740.049002:0:31422:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784938740.049006:0:31422:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97473bae19c0 10000000:01000000:3.0:1784938740.049008:0:31422:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1784938740.049011:0:31422:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff97473bae19c0 from 1 10000000:01000000:3.0:1784938740.049013:0:31422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784938740.049032:0:31422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e00c00/0xcd9d312a94a06cc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.049039:0:31422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974741e00c00/0xcd9d312a94a06cc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.049047:0:31422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974741e00c00/0xcd9d312a94a06cc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938740.049060:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342518528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938740.049090:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938740.049108:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938740.049165:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342518528 00000100:00100000:0.0:1784938740.049170:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342518528 00000100:00100000:0.0:1784938740.049202:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784938740.049214:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:31422:x1871643342518528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938740.049222:0:30624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938740.049232:0:30624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609396600/0xcd9d312a94a06cce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06cc7 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.049248:0:30624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609396600/0xcd9d312a94a06cce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06cc7 expref: 11 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.049257:0:30624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609396600/0xcd9d312a94a06cce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06cc7 expref: 11 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.049265:0:30624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609396600, rc 0) 00000100:00100000:0.0:1784938740.049290:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:31422:x1871643342518528:12345-0@lo:101:mount.lustre.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938740.049296:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784938740.049372:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342518528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938740.049383:0:31422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974741e00c00/0xcd9d312a94a06cc7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06cce expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.049392:0:31422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974741e00c00/0xcd9d312a94a06cc7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06cce expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938740.049406:0:31422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784938740.049426:0:31422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e00c00/0xcd9d312a94a06cc7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06cce expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.049433:0:31422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974741e00c00/0xcd9d312a94a06cc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06cce expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938740.049439:0:31422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784938740.049443:0:31422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784938740.049446:0:31422:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784938740.049448:0:31422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784938740.049461:0:31422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.049468:0:31422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.049474:0:31422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938740.049485:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342518656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938740.049638:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938740.049658:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938740.049704:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342518656 00000100:00100000:0.0:1784938740.049708:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342518656 00000100:00100000:0.0:1784938740.049736:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784938740.049742:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:31422:x1871643342518656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938740.049777:0:30624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938740.049787:0:30624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609397600/0xcd9d312a94a06cdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06cd5 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.049800:0:30624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609397600/0xcd9d312a94a06cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06cd5 expref: 12 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.049807:0:30624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609397600/0xcd9d312a94a06cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06cd5 expref: 12 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.049824:0:30624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609397600, rc 0) 00000100:00100000:0.0:1784938740.049850:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342518656:12345-0@lo:101:mount.lustre.0 Request processed in 109us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938740.049856:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784938740.049985:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342518656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938740.049995:0:31422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06cdc expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.050003:0:31422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06cdc expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938740.050140:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342518784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938740.050157:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938740.050181:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce69c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784938740.050240:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938740.050246:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd9d312a94a06cc0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.050253:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f800 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:2.0:1784938740.050256:0:31441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd9d312a94a06cc0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.050265:0:31441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcd9d312a94a06cc0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938740.050278:0:31441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcd9d312a94a06cc0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938740.050284:0:31441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938740.050300:0:31441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd9d312a94a06cc0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.050304:0:31441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938740.050327:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd9d312a94a06cc0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.050332:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460924f800/0xcd9d312a94a06cb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd9d312a94a06cc0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.050341:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938740.050343:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938740.050344:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938740.050353:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342518784 00000100:00100000:2.0:1784938740.050355:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342518784 00000100:00100000:2.0:1784938740.050374:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784938740.050380:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342518784:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938740.050499:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342518784:12345-0@lo:501:mount.lustre.0 Request processed in 119us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938740.050575:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938740.050583:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342518912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938740.050622:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938740.050705:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342518912 00000100:00100000:3.0:1784938740.050710:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342518912 00000100:00100000:2.0:1784938740.050819:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784938740.050926:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784938740.050934:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:12804:x1871643342518912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938740.050946:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938740.050958:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609397200/0xcd9d312a94a06cc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a06cb9 expref: 12 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938740.050970:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938740.051003:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:12804:x1871643342518912:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938740.051009:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784938740.051036:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342518912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938740.051084:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342518784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938740.051112:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938740.051145:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938740.051166:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938740.051189:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342519040 00000100:00100000:0.0:1784938740.051192:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342519040 00000100:00100000:0.0:1784938740.051216:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784938740.051222:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738763450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:31422:x1871643342519040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938740.051517:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738763450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:31422:x1871643342519040:12345-0@lo:503:mount.lustre.0 Request processed in 294us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938740.051524:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784938740.051602:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519040:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784938740.052297:0:31422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784938740.052362:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938740.052404:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938740.052429:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938740.052455:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342519168 00000100:00100000:0.0:1784938740.052461:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342519168 00000100:00100000:0.0:1784938740.052563:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784938740.052571:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:31422:x1871643342519168:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938740.052842:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:31422:x1871643342519168:12345-0@lo:502:mount.lustre.0 Request processed in 271us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938740.052849:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784938740.052869:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784938740.053041:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784938740.053072:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1784938740.053088:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1784938740.053113:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1784938740.053131:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1784938740.053147:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1784938740.053163:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938740.053195:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938740.053276:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938740.053338:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342519296 00000100:00100000:1.0:1784938740.053342:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342519296 00000100:00100000:1.0:1784938740.053403:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784938740.053411:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:31422:x1871643342519296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938740.053536:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:31422:x1871643342519296:12345-0@lo:502:mount.lustre.0 Request processed in 125us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938740.053542:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784938740.053608:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784938740.053707:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784938740.053718:0:31422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1784938740.054387:0:31442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784938740.054394:0:31442:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1784938740.054399:0:31442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938740.054402:0:31442:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784938740.054406:0:31442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784938740.054429:0:31442:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff974708c599c0) 00000020:00000080:3.0:1784938740.054452:0:31442:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784938740.054463:0:31442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784938740.054534:0:31442:0:(tgt_mount.c:153:server_get_mount()) get mount ffff974603c37000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784938740.054541:0:31442:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784938740.054547:0:31442:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd9d312a94a06cea 00010000:00010000:3.0:1784938740.057306:0:31442:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1784938740.057982:0:31442:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1784938740.060085:0:31442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784938740.060340:0:31442:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1784938740.066379:0:31442:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1784938740.067895:0:31442:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1784938740.069287:0:31442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1784938740.069300:0:31442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938740.069306:0:31442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938740.069308:0:31442:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1784938740.069312:0:31442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938740.069316:0:31442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938740.069317:0:31442:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784938740.069321:0:31442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784938740.069322:0:31442:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784938740.071439:0:31442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938740.071451:0:31442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938740.071453:0:31442:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784938740.071457:0:31442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1784938740.076674:0:31422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1784938740.076721:0:31422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784938740.076745:0:31422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06cdc expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.076772:0:31422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06cdc expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938740.076779:0:31422:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff974603c37000 from 1 10000000:01000000:1.0:1784938740.076783:0:31422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938740.076824:0:31422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.076831:0:31422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.076843:0:31422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938740.076869:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d62680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938740.076940:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938740.076983:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026db480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938740.077260:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342519424 00000100:00100000:2.0:1784938740.077269:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342519424 00000100:00100000:2.0:1784938740.077322:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784938740.077331:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738761450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:31422:x1871643342519424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938740.077356:0:30625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938740.077370:0:30625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460924f800/0xcd9d312a94a06cf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06cf1 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.077393:0:30625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924f800/0xcd9d312a94a06cf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06cf1 expref: 12 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.077403:0:30625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460924f800/0xcd9d312a94a06cf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06cf1 expref: 12 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.077412:0:30625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924f800, rc 0) 00000100:00100000:2.0:1784938740.077462:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738761450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342519424:12345-0@lo:101:mount.lustre.0 Request processed in 132us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938740.077469:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784938740.077606:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d62680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519424:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938740.077623:0:31422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06cf8 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938740.077632:0:31422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06cf8 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938740.077876:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938740.077909:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938740.077966:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974740de0480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938740.078476:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342519552 00000100:00100000:1.0:1784938740.078482:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342519552 00000100:00100000:1.0:1784938740.078560:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938740.078569:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342519552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938740.079038:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342519552:12345-0@lo:501:mount.lustre.0 Request processed in 470us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938740.079047:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784938740.079159:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938740.079197:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938740.079237:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938740.079295:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974740de0480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938740.079326:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342519680 00000100:00100000:1.0:1784938740.079331:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342519680 00000100:00100000:1.0:1784938740.079361:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784938740.079368:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342519680:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938740.079820:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342519680:12345-0@lo:503:mount.lustre.0 Request processed in 452us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938740.079827:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784938740.079955:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519680:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784938740.080169:0:31422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784938740.080221:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938740.080256:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938740.080321:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974740de0480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938740.080347:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342519808 00000100:00100000:2.0:1784938740.080350:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342519808 00000100:00100000:2.0:1784938740.080405:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784938740.080413:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342519808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938740.080553:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342519808:12345-0@lo:502:mount.lustre.0 Request processed in 140us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938740.080560:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784938740.080625:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519808:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784938740.080866:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1784938740.080913:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1784938740.080934:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938740.080968:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938740.081214:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974740de0480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938740.081272:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342519936 00000100:00100000:1.0:1784938740.081277:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342519936 00000100:00100000:1.0:1784938740.081302:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784938740.081310:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342519936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938740.081449:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342519936:12345-0@lo:502:mount.lustre.0 Request processed in 140us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938740.081456:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784938740.081530:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342519936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784938740.081660:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784938740.081671:0:31422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1784938740.082842:0:31446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938740.082852:0:31446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938740.082860:0:31446:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784938740.082867:0:31446:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff974603c37000 00000020:00000080:0.0:1784938740.082869:0:31446:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784938740.082894:0:31446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938740.082899:0:31446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938740.082900:0:31446:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784938740.082903:0:31446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1784938740.083438:0:31422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784938740.083460:0:31422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938740.083488:0:31422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06cf8 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.083507:0:31422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06cf8 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938740.083567:0:31422:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784938740.083570:0:31422:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff974603c37000 10000000:01000000:1.0:1784938740.083573:0:31422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff974603c37000 10000000:01000000:1.0:1784938740.083577:0:31422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938740.083582:0:31422:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff974603c37000 from 1 10000000:01000000:1.0:1784938740.083595:0:31422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938740.083627:0:31422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.083635:0:31422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.083645:0:31422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938740.083819:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342520064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938740.083872:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938740.083992:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974741f5c600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938740.084042:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342520064 00000100:00100000:3.0:1784938740.084049:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342520064 00000100:00100000:2.0:1784938740.084099:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784938740.084110:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342520064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938740.084122:0:30624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938740.084134:0:30624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460924f600/0xcd9d312a94a06d06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06cff expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.084156:0:30624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924f600/0xcd9d312a94a06d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06cff expref: 13 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.084174:0:30624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460924f600/0xcd9d312a94a06d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06cff expref: 13 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.084183:0:30624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924f600, rc 0) 00000100:00100000:2.0:1784938740.084224:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31422:x1871643342520064:12345-0@lo:101:mount.lustre.0 Request processed in 117us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938740.084231:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784938740.084318:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342520064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938740.084331:0:31422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d06 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.084339:0:31422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06d06 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938740.084437:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342520192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938740.084460:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938740.084494:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974741f5c600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938740.084713:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342520192 00000100:00100000:2.0:1784938740.084718:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342520192 00000100:00100000:2.0:1784938740.084745:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784938740.084780:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31422:x1871643342520192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938740.084996:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31422:x1871643342520192:12345-0@lo:501:mount.lustre.0 Request processed in 243us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938740.085003:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784938740.085381:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342520192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938740.085417:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342520320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938740.085460:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938740.085494:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974741f5c600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938740.085733:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342520320 00000100:00100000:2.0:1784938740.085738:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342520320 00000100:00100000:0.0:1784938740.086224:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784938740.086235:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31422:x1871643342520320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938740.086869:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31422:x1871643342520320:12345-0@lo:503:mount.lustre.0 Request processed in 635us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938740.086878:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784938740.086976:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342520320:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784938740.087273:0:31422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938740.087350:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342520448:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938740.087392:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938740.087429:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974741f5c600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938740.087623:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342520448 00000100:00100000:2.0:1784938740.087629:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342520448 00000100:00100000:2.0:1784938740.087819:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784938740.087827:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31422:x1871643342520448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938740.088116:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31422:x1871643342520448:12345-0@lo:502:mount.lustre.0 Request processed in 289us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938740.088123:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784938740.088325:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342520448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784938740.091047:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1784938740.091137:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1784938740.091173:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1784938740.091219:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1784938740.091254:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1784938740.091304:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1784938740.091340:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1784938740.091373:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1784938740.091460:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1784938740.092012:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1784938740.092055:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1784938740.092108:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1784938740.092144:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1784938740.092180:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1784938740.092232:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1784938740.092269:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1784938740.092302:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1784938740.092370:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1784938740.092405:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1784938740.092439:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1784938740.092633:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1784938740.092745:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1784938740.092907:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1784938740.092957:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1784938740.093012:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1784938740.093048:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1784938740.093100:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1784938740.093136:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1784938740.093191:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342520576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938740.093270:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938740.093376:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974740de0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938740.093423:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342520576 00000100:00100000:2.0:1784938740.093430:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342520576 00000100:00100000:2.0:1784938740.093720:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784938740.093731:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31422:x1871643342520576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938740.093977:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31422:x1871643342520576:12345-0@lo:502:mount.lustre.0 Request processed in 248us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938740.093985:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784938740.094090:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342520576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784938740.094166:0:31422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1784938740.094177:0:31422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1784938740.094885:0:31447:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784938740.094899:0:31447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff974708c58000) 00000020:00000080:3.0:1784938740.094919:0:31447:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1784938740.099336:0:31447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff974603c37000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784938740.099348:0:31447:0:(tgt_mount.c:187:server_put_mount()) put mount ffff974603c37000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784938740.099352:0:31447:0:(obd_mount.c:706:lustre_put_lsi()) put ffff974603c37000 3 00010000:00080000:3.0:1784938740.099405:0:31447:0:(ldlm_lib.c:125:import_set_conn()) imp ffff974718b1c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.104@tcp at head 00010000:00010000:3.0:1784938740.105453:0:31447:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1784938740.107013:0:31447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1784938740.107054:0:31447:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784938740.107067:0:31447:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcd9d312a94a06d14 00000100:00080000:3.0:1784938740.107079:0:31447:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.202.104@tcp last attempt 0 00000100:00080000:3.0:1784938740.107091:0:31447:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff974718b1c800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:3.0:1784938740.107127:0:31447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97472fc8aa00 x1871643342520704/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938740.107153:0:31447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784938740.107242:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342520704:192.168.202.104@tcp:38:llog_process_th.0 00000100:00100000:3.0:1784938740.107828:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938740.107861:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342520704 00000100:00100000:3.0:1784938740.107867:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342520704 00000100:00100000:3.0:1784938740.107895:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:3.0:1784938740.107902:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:12801:x1871643342520704:12345-192.168.202.104@tcp:38:llog_process_th.0 00010000:00080000:3.0:1784938740.107940:0:30632:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 893 last 0 00000020:00000080:3.0:1784938740.107972:0:30632:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcd9d312a94a06d1b 00000004:00100000:3.0:1784938740.107984:0:30632:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784938740.108017:0:30632:0:(import.c:65:import_set_state_nolock()) ffff974703e4f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938740.108059:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12801:x1871643342520704:12345-192.168.202.104@tcp:38:llog_process_th.0 Request processed in 156us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938740.108066:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 2 00010000:00080000:3.0:1784938740.108189:0:12801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97472fc8aa00 x1871643342520704/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938740.108200:0:12801:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784938740.108208:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1784938740.108214:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784938740.108218:0:12801:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784938740.108225:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974718b1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784938740.108231:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342520704:192.168.202.104@tcp:38:llog_process_th.0 00000100:00100000:3.0:1784938740.108458:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342520832:192.168.202.104@tcp:400:kworker.0 00000040:00080000:2.0:1784938740.108860:0:31447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1784938740.109243:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938740.109293:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342520832 00000100:00100000:2.0:1784938740.109298:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342520832 00000100:00100000:2.0:1784938740.109333:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:2.0:1784938740.109341:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342520832:12345-192.168.202.104@tcp:400:kworker.0 00000020:01000000:1.0:1784938740.109408:0:31422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1784938740.109439:0:31422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784938740.109455:0:31422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d06 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.109466:0:31422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d06 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784938740.109530:0:31422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784938740.109532:0:31422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784938740.109533:0:31422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938740.109535:0:31422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938740.109536:0:31422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938740.109537:0:31422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938740.109539:0:31422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938740.109540:0:31422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784938740.109542:0:31422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784938740.109543:0:31422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938740.109545:0:31422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784938740.109548:0:31422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1784938740.109550:0:31422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784938740.109555:0:31422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784938740.109556:0:31422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938740.109557:0:31422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938740.109558:0:31422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938740.109559:0:31422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938740.109560:0:31422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938740.109561:0:31422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784938740.109562:0:31422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784938740.109563:0:31422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938740.109564:0:31422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784938740.109580:0:31422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784938740.109602:0:31422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342520960:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784938740.109641:0:31422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938740.109677:0:31422:0:(client.c:2702:ptlrpc_set_wait()) set ffff974741f5c300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938740.109946:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342520832:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 604us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938740.109954:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:2.0:1784938740.109979:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342520960 00000100:00100000:2.0:1784938740.109983:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342520960 00000100:00100000:2.0:1784938740.110013:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784938740.110019:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31422:x1871643342520960:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784938740.110050:0:30624:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784938740.110062:0:30624:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1784938740.113465:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff974607d63800 x1871643342520832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938740.113613:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342520832:192.168.202.104@tcp:400:kworker.0 20000000:01000000:3.0:1784938740.127394:0:30624:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784938740.127411:0:30624:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784938740.127842:0:30646:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784938740.127849:0:30646:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784938740.127872:0:30646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.127889:0:30646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974609397400/0xcd9d312a94a06c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06c73 expref: 13 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.127899:0:30646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.127938:0:30646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974609397400/0xcd9d312a94a06c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06c73 expref: 13 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.127953:0:30646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974609397400/0xcd9d312a94a06c7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06c73 expref: 13 pid: 30625 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938740.127970:0:30646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:30646:1871643342521088:0@lo:104: 00000100:00100000:1.0:1784938740.128035:0:30646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938740.128079:0:30646:0:(client.c:2702:ptlrpc_set_wait()) set ffff974741f5c540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938740.128143:0:30613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342521088 00000100:00100000:2.0:1784938740.128151:0:30613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342521088 00000100:00100000:2.0:1784938740.128193:0:30613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784938740.128202:0:30613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30646:x1871643342521088:12345-0@lo:104: 00010000:00010000:2.0:1784938740.128215:0:30613:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06c7a expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128275:0:30613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938740.128282:0:30613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30646:x1871643342521088:12345-0@lo:104: Request processed in 82us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938740.128289:0:30613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1784938740.128309:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938740.128316:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06c7a expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128324:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29800 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:2.0:1784938740.128328:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06c7a expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128337:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06c7a expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938740.128346:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06c7a expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938740.128352:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938740.128376:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c7a expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128382:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938740.128399:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c7a expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128406:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06c73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c7a expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128428:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938740.128431:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938740.128433:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938740.128450:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342521216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938740.128480:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938740.128525:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342521216 00000100:00100000:2.0:1784938740.128529:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342521216 00010000:00010000:2.0:1784938740.128543:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974609397400/0xcd9d312a94a06c7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06c73 expref: 14 pid: 30625 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938740.128563:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784938740.128568:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97470988d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:12803:x1871643342521216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938740.128578:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938740.128595:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974609397400/0xcd9d312a94a06c7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06c73 expref: 14 pid: 30625 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128606:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974609397400/0xcd9d312a94a06c7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06c73 expref: 14 pid: 30625 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128622:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128630:0:30616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784938740.128643:0:30616:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000897789s 00010000:00010000:2.0:1784938740.128711:0:30616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128731:0:30616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128739:0:30616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128746:0:30616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128778:0:30616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938740.128782:0:30616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128789:0:30616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128797:0:30616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938740.128806:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938740.128832:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97470988d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:12803:x1871643342521216:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938740.128840:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784938740.128894:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342521216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938740.129127:0:30646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609397400/0xcd9d312a94a06c7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06c73 expref: 13 pid: 30625 timeout: 993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938740.129137:0:30646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:30646:1871643342521088:0@lo:104: 00010000:00010000:1.0:1784938740.129149:0:30646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.129158:0:30646:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.129164:0:30646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938740.129171:0:30646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974735f28000/0xcd9d312a94a06d22 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938740.135824:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:31422:x1871643342520960:12345-0@lo:253:mount.lustre.0 Request processed in 25796us (26173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938740.135839:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784938740.135966:0:31422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:31422:1871643342520960:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784938740.135981:0:31422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784938740.135985:0:31422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784938740.135986:0:31422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784938740.135988:0:31422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938740.135989:0:31422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938740.135990:0:31422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938740.135991:0:31422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938740.135993:0:31422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938740.135994:0:31422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784938740.135995:0:31422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784938740.135997:0:31422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938740.135998:0:31422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784938740.136012:0:31422:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784938740.136597:0:31422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1784938740.137282:0:31422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784938740.137486:0:31422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1784938740.137740:0:31422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784938740.137958:0:31422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1784938740.138168:0:31422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1784938740.139292:0:31422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1784938740.204699:0:31422:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1784938740.204708:0:31422:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1784938740.204776:0:31422:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784938740.204858:0:31422:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784938740.204874:0:31422:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1784938740.204902:0:31422:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1784938741.043636:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784938741.746881:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784938741.746889:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9747294ad000 from 21 10000000:01000000:2.0:1784938741.746894:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784938741.746940:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938741.746963:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938741.746976:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938741.747003:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342521344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938741.747150:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938741.747200:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747040060c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938741.747302:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342521344 00000100:00100000:0.0:1784938741.747312:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342521344 00000100:00100000:0.0:1784938741.747370:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784938741.747379:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342521344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938741.747401:0:30625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938741.747412:0:30625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609396a00/0xcd9d312a94a06d30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06d29 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938741.747435:0:30625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609396a00/0xcd9d312a94a06d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06d29 expref: 13 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938741.747446:0:30625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609396a00/0xcd9d312a94a06d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06d29 expref: 13 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938741.747455:0:30625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609396a00, rc 0) 00000100:00100000:0.0:1784938741.747497:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342521344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938741.747504:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784938741.747548:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342521344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938741.747562:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d30 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938741.747580:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06d30 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938741.747669:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342521472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938741.747695:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938741.747707:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747360930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938741.747923:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342521472 00000100:00100000:3.0:1784938741.747928:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342521472 00000100:00100000:3.0:1784938741.747961:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784938741.747969:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342521472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938741.748249:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342521472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938741.748256:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784938741.748453:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342521472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938741.748486:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342521600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938741.748535:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938741.748563:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747360930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938741.748874:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342521600 00000100:00100000:3.0:1784938741.748880:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342521600 00000100:00100000:3.0:1784938741.748906:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784938741.748912:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342521600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938741.749213:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342521600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 299us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938741.749220:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784938741.749929:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342521600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938741.753929:0:31520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:31520:1871643342521728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938741.754020:0:31520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938741.755214:0:31520:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704dbd840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938741.762252:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342521728 00000100:00100000:0.0:1784938741.762267:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342521728 00000100:00100000:1.0:1784938741.768942:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784938741.768956:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31520:x1871643342521728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938741.769277:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31520:x1871643342521728:12345-0@lo:502:llog_process_th.0 Request processed in 324us (15256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938741.769285:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784938741.769350:0:31520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:31520:1871643342521728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938741.769416:0:31520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:31520:1871643342521856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938741.769452:0:31520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938741.769483:0:31520:0:(client.c:2702:ptlrpc_set_wait()) set ffff974740ef6000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938741.769628:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342521856 00000100:00100000:2.0:1784938741.769642:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342521856 00000100:00100000:2.0:1784938741.769674:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784938741.769681:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31520:x1871643342521856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938741.769844:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:31520:x1871643342521856:12345-0@lo:502:llog_process_th.0 Request processed in 163us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938741.769851:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784938741.771279:0:31520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:31520:1871643342521856:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784938741.771322:0:31520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1784938741.773517:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1784938741.773552:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784938741.773564:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d30 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938741.773585:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d30 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938741.773603:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784938741.773605:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9747294ad000 from 4 10000000:01000000:2.0:1784938741.773608:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784938741.773774:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938741.773784:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938741.773795:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938741.773823:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342521984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938741.773892:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938741.773931:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704006cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938741.773950:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342521984 00000100:00100000:2.0:1784938741.773956:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342521984 00000100:00100000:2.0:1784938741.773997:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784938741.774005:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342521984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938741.774018:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938741.774031:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460924e200/0xcd9d312a94a06d3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06d37 expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938741.774053:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924e200/0xcd9d312a94a06d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06d37 expref: 14 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938741.774065:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460924e200/0xcd9d312a94a06d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06d37 expref: 14 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938741.774714:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924e200, rc 0) 00000100:00100000:2.0:1784938741.774815:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342521984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 809us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938741.774823:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784938741.775558:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342521984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938741.775589:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d3e expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938741.775607:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06d3e expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938741.775677:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342522112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784938741.775724:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938741.775776:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938741.775924:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342522112 00000100:00100000:2.0:1784938741.775931:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342522112 00000100:00100000:2.0:1784938741.775981:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784938741.775990:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342522112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784938741.776007:0:30623:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784938741.776024:0:30623:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784938741.776027:0:30623:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1784938741.776770:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342522112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 758us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938741.776781:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784938741.776876:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342522112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784938741.776932:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784938741.776941:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d3e expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938741.776950:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d3e expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938741.776959:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784938741.776962:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1784938741.776965:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784938741.776991:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938741.777005:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938741.777014:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938741.777031:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342522240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938741.777062:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938741.777198:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938741.777230:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342522240 00000100:00100000:2.0:1784938741.777234:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342522240 00000100:00100000:2.0:1784938741.779653:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784938741.779670:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974736698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342522240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938741.779689:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938741.779708:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460924f000/0xcd9d312a94a06d4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06d45 expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938741.779735:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924f000/0xcd9d312a94a06d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06d45 expref: 15 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938741.779748:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460924f000/0xcd9d312a94a06d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06d45 expref: 15 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938741.779771:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924f000, rc 0) 00000100:00100000:2.0:1784938741.779848:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974736698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342522240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938741.779856:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784938741.787507:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342522240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938741.787552:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d4c expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938741.787566:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06d4c expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938741.787814:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342522368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938741.787874:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938741.787918:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704006a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938741.787993:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342522368 00000100:00100000:1.0:1784938741.788000:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342522368 00000100:00100000:1.0:1784938741.788047:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784938741.788056:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342522368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938741.788345:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342522368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938741.788365:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784938741.788780:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342522368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938741.788814:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342522496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938741.788857:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938741.788883:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704006a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938741.789175:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342522496 00000100:00100000:1.0:1784938741.789180:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342522496 00000100:00100000:1.0:1784938741.789216:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784938741.789223:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342522496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938741.793956:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342522496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4722us (5087us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938741.793972:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784938741.794052:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342522496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938741.794418:0:31523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:31523:1871643342522624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938741.794467:0:31523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938741.794499:0:31523:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938741.794772:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342522624 00000100:00100000:3.0:1784938741.794780:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342522624 00000100:00100000:3.0:1784938741.794819:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784938741.794836:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:31523:x1871643342522624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938741.795104:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:31523:x1871643342522624:12345-0@lo:502:llog_process_th.0 Request processed in 269us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938741.795111:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784938741.796820:0:31523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:31523:1871643342522624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938741.796863:0:31523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784938741.796871:0:31523:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784938741.796879:0:31523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938741.796881:0:31523:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784938741.796889:0:31523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784938741.796893:0:31523:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:1.0:1784938741.796919:0:31523:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784938741.796923:0:31523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938741.796940:0:31523:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9747034a8000) 00000020:00000080:1.0:1784938741.796962:0:31523:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1784938741.796968:0:31523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784938741.797054:0:31523:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784938741.797060:0:31523:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784938741.797067:0:31523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a06d5a 00010000:00080000:1.0:1784938741.797114:0:31523:0:(ldlm_lib.c:125:import_set_conn()) imp ffff974607a56800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1784938741.797341:0:31523:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1784938741.890158:0:31523:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1784938741.890180:0:31523:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784938741.891080:0:31523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938741.891256:0:31523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938741.891304:0:31523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1784938741.891364:0:31523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1784938741.898822:0:31526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938741.898832:0:31526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784938741.925159:0:31523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784938741.925176:0:31523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784938741.925217:0:31523:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784938741.925238:0:31523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a06d61 00000100:00080000:1.0:1784938741.925251:0:31523:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.202.104@tcp last attempt 0 00000100:00080000:1.0:1784938741.925263:0:31523:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff974607a56800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:1.0:1784938741.925299:0:31523:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974607d63480 x1871643342522752/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938741.925371:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342522752:192.168.202.104@tcp:8:llog_process_th.0 00000100:00100000:2.0:1784938741.925671:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00080000:1.0:1784938741.925942:0:31523:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1784938741.926033:0:31523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938741.926039:0:31523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938741.926041:0:31523:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784938741.926044:0:31523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938741.926048:0:31523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938741.926049:0:31523:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784938741.926052:0:31523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784938741.926054:0:31523:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784938741.926083:0:31523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:31523:1871643342522880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938741.926132:0:31523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938741.926164:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342522880 00000100:00100000:1.0:1784938741.926171:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342522880 00000100:00100000:1.0:1784938741.926209:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784938741.926217:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:31523:x1871643342522880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938741.926434:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:31523:x1871643342522880:12345-0@lo:502:llog_process_th.0 Request processed in 217us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938741.926442:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784938741.926493:0:31523:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938741.926514:0:31523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:31523:1871643342522880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938741.926537:0:31523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938741.926541:0:31523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938741.926543:0:31523:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784938741.926547:0:31523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1784938741.926979:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342522752 00000100:00100000:0.0:1784938741.926985:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342522752 00000100:00100000:0.0:1784938741.927046:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:0.0:1784938741.927051:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:12801:x1871643342522752:12345-192.168.202.104@tcp:8:llog_process_th.0 00010000:00080000:0.0:1784938741.927071:0:31425:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 895 last 0 00000020:00000080:0.0:1784938741.927097:0:31425:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a06d68 00002000:00100000:0.0:1784938741.927108:0:31425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9746022e7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784938741.927113:0:31425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1784938741.927116:0:31425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1784938741.927228:0:31425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784938741.927378:0:31425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784938741.927405:0:31425:0:(import.c:65:import_set_state_nolock()) ffff9746022e7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938741.927453:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:12801:x1871643342522752:12345-192.168.202.104@tcp:8:llog_process_th.0 Request processed in 400us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938741.927460:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 0 00000020:01000000:1.0:1784938741.927520:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1784938741.927541:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784938741.927550:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d4c expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938741.927561:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d4c expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938741.927582:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784938741.927584:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97473bae19c0 from 1 10000000:01000000:1.0:1784938741.927587:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784938741.928003:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938741.928013:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938741.928021:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938741.928054:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342523264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938741.928094:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938741.928124:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938741.928144:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342523264 00000100:00100000:1.0:1784938741.928149:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342523264 00000100:00100000:1.0:1784938741.928174:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784938741.928181:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342523264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938741.928190:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938741.928203:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974735f28200/0xcd9d312a94a06d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06d6f expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938741.928223:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974735f28200/0xcd9d312a94a06d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06d6f expref: 16 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938741.928233:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974735f28200/0xcd9d312a94a06d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06d6f expref: 16 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938741.928242:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f28200, rc 0) 00000100:00100000:1.0:1784938741.928271:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342523264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938741.928277:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784938741.928317:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342523264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938741.928329:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d76 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938741.928338:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06d76 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938741.928390:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342523392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938741.928417:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938741.928431:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938741.928445:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342523392 00000100:00100000:1.0:1784938741.928448:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342523392 00000100:00100000:1.0:1784938741.928468:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784938741.928475:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342523392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938741.929222:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342523392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 744us (801us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784938741.929230:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784938741.929271:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342523392:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784938741.929297:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784938741.929305:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d76 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938741.929313:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06d76 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938741.929948:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342523136:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938741.930004:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938741.930012:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342523008:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938741.930095:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938741.930144:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938741.930168:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342523136 00000100:00100000:3.0:1784938741.930173:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342523136 00000100:00100000:3.0:1784938741.930219:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342523008 00000100:00100000:3.0:1784938741.930222:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342523008 00000100:00100000:3.0:1784938741.930239:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00100000:3.0:1784938741.930247:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342523136:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938741.930286:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342523136:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 39us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938741.930292:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00100000:3.0:1784938741.930308:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00100000:3.0:1784938741.930315:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342523008:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938741.930339:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342523008:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 24us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938741.930357:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 4 00010000:00080000:3.0:1784938741.930470:0:12805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9747358fbb80 x1871643342523008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938741.930483:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342523008:192.168.202.104@tcp:400:kworker.0 00010000:00080000:3.0:1784938741.930495:0:12805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9747358fb800 x1871643342523136/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938741.930503:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342523136:192.168.202.104@tcp:400:kworker.0 00010000:00080000:3.0:1784938741.930534:0:12801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974607d63480 x1871643342522752/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938741.930542:0:12801:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784938741.930550:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784938741.930558:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784938741.930564:0:12801:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784938741.930568:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974607a56800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784938741.930601:0:12801:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784938741.930608:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342522752:192.168.202.104@tcp:8:llog_process_th.0 00000004:00080000:3.0:1784938741.930628:0:31526:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784938741.930790:0:31526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 895768037911ns, next at 0ns, rc = 0 00000100:00080000:1.0:1784938741.931327:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1784938742.003274:0:30612:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1784938742.035320:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342523520:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938742.035785:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938742.035826:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342523520 00000100:00100000:1.0:1784938742.035833:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342523520 00000100:00100000:1.0:1784938742.035888:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:1.0:1784938742.035897:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:12802:x1871643342523520:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938742.035939:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 390070272 avail 387973120 00000100:00100000:1.0:1784938742.035982:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:12802:x1871643342523520:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 85us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938742.035990:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00080000:1.0:1784938742.036013:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1784938742.036128:0:31529:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1784938742.036160:0:31529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31529:1871643342523648:192.168.202.104@tcp:7:osp-pre-0-0.0 00000100:00100000:0.0:1784938742.036202:0:31529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938742.036478:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938742.036557:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342523648 00000100:00100000:2.0:1784938742.036562:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342523648 00000100:00100000:2.0:1784938742.036610:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:2.0:1784938742.036617:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:31529:x1871643342523648:12345-192.168.202.104@tcp:7:osp-pre-0-0.0 00002000:00080000:2.0:1784938742.044546:0:31428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1784938742.044556:0:31428:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00080000:3.0:1784938742.044814:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97473a634380 x1871643342523520/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938742.044842:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342523520:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938742.045263:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:31529:x1871643342523648:12345-192.168.202.104@tcp:7:osp-pre-0-0.0 Request processed in 8643us (8782us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938742.045273:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 1 00010000:00080000:1.0:1784938742.045536:0:31529:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97473a635c00 x1871643342523648/t0(0) o7->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 264/240 e 0 to 0 dl 1784938758 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938742.045548:0:31529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31529:1871643342523648:192.168.202.104@tcp:7:osp-pre-0-0.0 00000004:00080000:1.0:1784938742.045561:0:31529:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1784938742.045620:0:31529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d63100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31529:1871643342523776:192.168.202.104@tcp:5:osp-pre-0-0.0 00000100:00100000:1.0:1784938742.045735:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938742.045783:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342523776 00000100:00100000:1.0:1784938742.045790:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342523776 00000100:00100000:1.0:1784938742.045832:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:1.0:1784938742.045839:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:31529:x1871643342523776:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1784938742.045868:0:31425:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1784938742.045871:0:31425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1784938742.046153:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:31529:x1871643342523776:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 Request processed in 313us (417us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784938742.046161:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:1.0:1784938742.046352:0:31529:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a9c0 going to sleep for 11 seconds 00010000:00080000:1.0:1784938742.046369:0:31529:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974607d63100 x1871643342523776/t0(0) o5->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938758 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938742.046381:0:31529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d63100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31529:1871643342523776:192.168.202.104@tcp:5:osp-pre-0-0.0 00000004:00080000:1.0:1784938742.046398:0:31529:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1784938742.046425:0:31529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31529:1871643342523904:192.168.202.104@tcp:700:osp-pre-0-0.0 00000100:00100000:1.0:1784938742.046517:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938742.046556:0:31434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342523904 00000100:00100000:1.0:1784938742.046562:0:31434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342523904 00000100:00100000:1.0:1784938742.046602:0:31434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:1.0:1784938742.046610:0:31434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:31529:x1871643342523904:12345-192.168.202.104@tcp:700:osp-pre-0-0.0 00000100:00100000:1.0:1784938742.046640:0:31434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:31434:1871643342524032:192.168.202.104@tcp:700:ll_ost_seq00_00.0 00000100:00100000:1.0:1784938742.046674:0:31434:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938742.046745:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938742.046802:0:30637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342524032 00000100:00100000:1.0:1784938742.046806:0:30637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342524032 00000100:00100000:1.0:1784938742.046832:0:30637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:1.0:1784938742.046838:0:30637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:31434:x1871643342524032:12345-192.168.202.104@tcp:700:ll_ost_seq00_00.0 00000100:00100000:1.0:1784938742.047486:0:31529:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784938742.068869:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1784938742.090430:0:30637:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1784938742.096183:0:30637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:31434:x1871643342524032:12345-192.168.202.104@tcp:700:ll_ost_seq00_00.0 Request processed in 49333us (49427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938742.096203:0:30637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 0 00010000:00080000:3.0:1784938742.096448:0:31434:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974607d61f80 x1871643342524032/t0(0) o700->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:32/10 lens 264/248 e 0 to 0 dl 1784938758 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_ost_seq00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938742.096464:0:31434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:31434:1871643342524032:192.168.202.104@tcp:700:ll_ost_seq00_00.0 40000000:02000000:3.0:1784938742.096477:0:31434:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1784938742.156184:0:31434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:31529:x1871643342523904:12345-192.168.202.104@tcp:700:osp-pre-0-0.0 Request processed in 109564us (109656us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938742.156204:0:31434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 0 00000001:00100000:3.0:1784938742.156241:0:31424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784938742.156255:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:1.0:1784938742.156521:0:31529:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974607d60000 x1871643342523904/t0(0) o700->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:31/4 lens 264/248 e 0 to 0 dl 1784938758 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938742.156539:0:31529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31529:1871643342523904:192.168.202.104@tcp:700:osp-pre-0-0.0 00000004:02000040:0.0:1784938742.190805:0:31529:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1784938742.195062:0:31529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31529:1871643342524160:192.168.202.104@tcp:5:osp-pre-0-0.0 00000100:00100000:0.0:1784938742.195295:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938742.195357:0:31529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938742.198663:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342524160 00000100:00100000:1.0:1784938742.198675:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342524160 00000100:00100000:1.0:1784938742.198731:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00100000:1.0:1784938742.198741:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:31529:x1871643342524160:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 00002000:00080000:0.0:1784938742.207043:0:31428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1784938742.207067:0:31428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 2 00002000:00080000:0.0:1784938742.207953:0:31428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 10 00000001:00080000:0.0:1784938742.208401:0:31428:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967298 00002000:00080000:0.0:1784938742.208665:0:31428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 18 00000001:00080000:0.0:1784938742.209174:0:31428:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967299 00002000:00080000:0.0:1784938742.209251:0:31428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 26 00000001:00080000:0.0:1784938742.209853:0:31428:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967300 00000100:00100000:0.0:1784938742.210004:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:31529:x1871643342524160:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 Request processed in 11260us (14705us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1784938742.210014:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 3 00000020:00080000:0.0:1784938742.210019:0:31428:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00010000:00080000:0.0:1784938742.210198:0:31529:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97473a635f80 x1871643342524160/t0(0) o5->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938758 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938742.210210:0:31529:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1784938742.210224:0:31529:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff97473a635f80 x1871643342524160/t4294967301(4294967301) o5->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938758 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938742.210236:0:31529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31529:1871643342524160:192.168.202.104@tcp:5:osp-pre-0-0.0 00000004:00080000:0.0:1784938742.210248:0:31529:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1784938743.093869:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938744.117093:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938745.144972:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938746.164948:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784938747.082381:0:31793:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784938747.189040:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938747.257846:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342524288:0@lo:400:kworker.0 00000100:00100000:0.0:1784938747.257918:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938747.257969:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938747.257977:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342524672:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938747.258040:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342524416:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938747.258071:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938747.258077:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342524544:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938747.258112:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342524288 00000100:00100000:0.0:1784938747.258119:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342524288 00000100:00100000:0.0:1784938747.258161:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784938747.258169:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:12803:x1871643342524288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938747.258216:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:12803:x1871643342524288:12345-0@lo:400:kworker.0 Request processed in 47us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938747.258223:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784938747.258403:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938747.258454:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938747.258475:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938747.258507:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342524416 00000100:00100000:0.0:1784938747.258511:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342524416 00000100:00100000:0.0:1784938747.258550:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342524544 00000100:00100000:0.0:1784938747.258553:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342524544 00000100:00100000:0.0:1784938747.258578:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:0.0:1784938747.258585:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342524416:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938747.258618:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342524416:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 33us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938747.258642:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:0.0:1784938747.258656:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 6 00000100:00100000:0.0:1784938747.258662:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342524544:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938747.258689:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342524544:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 28us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938747.258694:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 6 00000100:00100000:0.0:1784938747.258714:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342524672 00000100:00100000:0.0:1784938747.258718:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342524672 00000100:00100000:0.0:1784938747.258743:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:0.0:1784938747.258774:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:12803:x1871643342524672:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938747.258799:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:12803:x1871643342524672:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 50us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938747.258805:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00080000:0.0:1784938747.258827:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938747.258831:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784938747.258950:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97473a636680 x1871643342524544/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938747.258964:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342524544:192.168.202.104@tcp:400:kworker.0 00010000:00080000:0.0:1784938747.258974:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97473a637800 x1871643342524416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938747.258983:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342524416:192.168.202.104@tcp:400:kworker.0 00010000:00080000:0.0:1784938747.259010:0:12803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97473a634a80 x1871643342524672/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938747.259030:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342524672:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938747.259041:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342524288:0@lo:400:kworker.0 00000100:00100000:0.0:1784938747.262047:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938747.262072:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342524800:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938747.262287:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938747.262330:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342524800 00000100:00100000:0.0:1784938747.262337:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342524800 00000100:00100000:0.0:1784938747.262409:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:0.0:1784938747.262417:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:12802:x1871643342524800:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938747.262451:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 390070272 avail 387973120 00000100:00100000:0.0:1784938747.262488:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:12802:x1871643342524800:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938747.262494:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 1 00010000:00080000:0.0:1784938747.262636:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97473a635180 x1871643342524800/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938747.262655:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342524800:192.168.202.104@tcp:13:osp-pre-0-0.0 00000001:00080000:3.0:1784938747.410642:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:0.0:1784938748.217213:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938749.236268:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938750.259093:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938751.283912:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938752.311996:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938752.371951:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342524928:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938752.372215:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938752.372264:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342524928 00000100:00100000:2.0:1784938752.372272:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342524928 00000100:00100000:2.0:1784938752.372325:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:2.0:1784938752.372334:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342524928:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938752.372366:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 390070272 avail 387973120 00000100:00100000:2.0:1784938752.372427:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342524928:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 93us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938752.372434:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00080000:2.0:1784938752.372455:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784938752.373057:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9747358f8380 x1871643342524928/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938752.373069:0:12804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000100:00100000:1.0:1784938752.373091:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342524928:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938752.380711:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938752.380732:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342525056:0@lo:400:kworker.0 00000100:00100000:0.0:1784938752.380832:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938752.380901:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342525056 00000100:00100000:0.0:1784938752.380908:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342525056 00000100:00100000:0.0:1784938752.380958:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784938752.380966:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:12804:x1871643342525056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938752.381016:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:12804:x1871643342525056:12345-0@lo:400:kworker.0 Request processed in 50us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938752.381023:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784938752.381073:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342525056:0@lo:400:kworker.0 00000100:00100000:3.0:1784938752.381207:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342525184:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938752.381321:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:12803:1871643342525312:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938752.381581:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938752.381648:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938752.381672:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342525184 00000100:00100000:3.0:1784938752.381677:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342525184 00000100:00100000:3.0:1784938752.381711:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342525312 00000100:00100000:3.0:1784938752.381721:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342525312 00000100:00100000:3.0:1784938752.381772:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 7 00000100:00100000:3.0:1784938752.381779:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342525184:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938752.381816:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342525184:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 37us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938752.381823:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 7 00000100:00100000:3.0:1784938752.381837:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 8 00000100:00100000:3.0:1784938752.381843:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12803:x1871643342525312:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938752.382247:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12803:x1871643342525312:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 23us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938752.382255:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 8 00000100:00080000:3.0:1784938752.382277:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784938752.382397:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97472fc8b480 x1871643342525184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938752.382410:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342525184:192.168.202.104@tcp:400:kworker.0 00010000:00080000:3.0:1784938752.382435:0:12803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97472fc8ad80 x1871643342525312/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938752.382443:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:12803:1871643342525312:192.168.202.104@tcp:400:kworker.0 00010000:00010000:3.0:1784938753.331238:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938754.357048:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938755.378993:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938756.404940:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784938757.184991:0:32268:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:3.0:1784938757.184997:0:32268:0:(obd_mount.c:922:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1784938757.185146:0:32268:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff974724c7c800 00000020:01000004:3.0:1784938757.185170:0:32268:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1784938757.185188:0:32268:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1784938757.185221:0:32268:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff974708c5cd40) 00000020:00000080:3.0:1784938757.185244:0:32268:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784938757.224967:0:32268:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1784938757.227281:0:32268:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1784938757.403000:0:32268:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1784938757.410395:0:32268:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1784938757.410433:0:32268:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1784938757.411199:0:32268:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1784938757.411365:0:32268:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1784938757.412306:0:32268:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1784938757.412324:0:32268:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784938757.412339:0:32268:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd9d312a94a06d84 00000020:01000004:1.0:1784938757.412351:0:32268:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1784938757.412387:0:32268:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784938757.412391:0:32268:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784938757.412399:0:32268:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1784938757.412428:0:32268:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1784938757.412434:0:32268:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:0.0:1784938757.430150:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938757.492121:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342525440:0@lo:400:kworker.0 00000100:00100000:3.0:1784938757.492229:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.492300:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938757.492310:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342525568:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938757.492392:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342525696:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938757.492425:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938757.492431:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342525824:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938757.492497:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342525440 00000100:00100000:3.0:1784938757.492517:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342525440 00000100:00100000:3.0:1784938757.493883:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784938757.493901:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:12804:x1871643342525440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938757.494015:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:12804:x1871643342525440:12345-0@lo:400:kworker.0 Request processed in 120us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.494023:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784938757.494274:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938757.494363:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938757.494392:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938757.494436:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342525696 00000100:00100000:3.0:1784938757.501104:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342525696 00000100:00100000:3.0:1784938757.502111:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342525568 00000100:00100000:3.0:1784938757.502124:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342525568 00000100:00100000:3.0:1784938757.502214:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 9 00000100:00100000:3.0:1784938757.502228:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342525568:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938757.502347:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342525568:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 121us (7983us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.502357:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 9 00000100:00100000:3.0:1784938757.502394:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342525824 00000100:00100000:3.0:1784938757.502398:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342525824 00000100:00100000:3.0:1784938757.502458:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:3.0:1784938757.502466:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342525824:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938757.502503:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342525824:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 38us (8110us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.502522:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00080000:3.0:1784938757.502555:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938757.502574:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938757.502596:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342525952:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938757.506347:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938757.506391:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342525952 00000100:00100000:3.0:1784938757.506402:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342525952 00000100:00100000:3.0:1784938757.506482:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00100000:3.0:1784938757.506494:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342525952:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938757.508912:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 390070272 avail 387973120 00000100:00100000:3.0:1784938757.509029:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342525952:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 2529us (2689us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.509041:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 3 00010000:00080000:3.0:1784938757.509134:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97472fc8a680 x1871643342525824/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938757.509154:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342525824:192.168.202.104@tcp:400:kworker.0 00010000:00080000:3.0:1784938757.517049:0:12805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9747358fa300 x1871643342525952/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938757.517099:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342525952:192.168.202.104@tcp:13:osp-pre-0-0.0 00010000:00080000:3.0:1784938757.517426:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97472fc8b480 x1871643342525568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938757.517439:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342525568:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938757.517475:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342525440:0@lo:400:kworker.0 00000100:00100000:3.0:1784938757.517586:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 10 00000100:00100000:3.0:1784938757.517596:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342525696:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938757.517837:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342525696:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 241us (23565us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.517846:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 10 00000100:00080000:3.0:1784938757.517875:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784938757.518129:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97472fc8b800 x1871643342525696/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938757.518140:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342525696:192.168.202.104@tcp:400:kworker.0 00000040:01000000:3.0:1784938757.645016:0:32268:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784938757.645071:0:32268:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.104@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1784938757.645077:0:32268:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784938757.645079:0:32268:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938757.645080:0:32268:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938757.645082:0:32268:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938757.645084:0:32268:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938757.645085:0:32268:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938757.645091:0:32268:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938757.645093:0:32268:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938757.645094:0:32268:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938757.645096:0:32268:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938757.645098:0:32268:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938757.645103:0:32268:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1784938757.645105:0:32268:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784938757.645106:0:32268:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938757.645107:0:32268:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938757.645108:0:32268:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938757.645109:0:32268:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938757.645109:0:32268:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938757.645110:0:32268:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938757.645111:0:32268:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938757.645112:0:32268:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938757.645112:0:32268:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938757.645113:0:32268:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938757.645152:0:32268:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784938757.645183:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342526080:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784938757.645298:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.645483:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff974710412c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938757.646379:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342526080 00000100:00100000:0.0:1784938757.646393:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342526080 00000100:00100000:1.0:1784938757.647209:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784938757.647224:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:32268:x1871643342526080:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784938757.647282:0:30624:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784938757.647288:0:30624:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1784938757.647294:0:30624:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1784938757.647298:0:30624:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1784938757.650194:0:30624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938757.650988:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1784938757.651022:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1784938757.651083:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1784938757.651092:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1784938757.651125:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1784938757.651179:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1784938757.652048:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1784938757.652077:0:30624:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.104@tcp 20000000:01000000:1.0:1784938757.652079:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:1.0:1784938757.652120:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1784938757.652128:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784938757.652208:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1784938757.652218:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:1.0:1784938757.652253:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1784938757.652264:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784938757.652378:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1784938757.652432:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1784938757.655038:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1784938757.655081:0:30624:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.104@tcp 20000000:01000000:1.0:1784938757.655084:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:1.0:1784938757.655128:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1784938757.655136:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784938757.655168:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1784938757.655176:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:1.0:1784938757.655205:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1784938757.655214:0:30624:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784938757.655262:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1784938757.656054:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1784938757.656085:0:30624:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784938757.656089:0:30624:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784938757.656094:0:30624:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784938757.656113:0:30624:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784938757.656133:0:30624:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784938757.656192:0:30624:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784938757.656196:0:30624:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784938757.657832:0:32271:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1784938757.657940:0:32271:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1784938757.658001:0:32271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1784938757.659330:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1784938757.659389:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1784938757.659714:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1784938757.659734:0:30624:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1784938757.659738:0:30624:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784938757.660909:0:32272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1784938757.661374:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1784938757.661423:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1784938757.661537:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1784938757.661980:0:30624:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784938757.661984:0:30624:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784938757.666052:0:32273:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1784938757.666177:0:32273:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1784938757.666389:0:32273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1784938757.667729:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1784938757.668009:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1784938757.668049:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1784938757.668071:0:30624:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1784938757.668075:0:30624:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784938757.669728:0:32274:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1784938757.670043:0:32274:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1784938757.670078:0:32274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1784938757.671031:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1784938757.671090:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1784938757.671162:0:30624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1784938757.671190:0:30624:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1784938757.671193:0:30624:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1784938757.671209:0:30624:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784938757.671304:0:30624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.671353:0:30624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974609397600/0xcd9d312a94a06cdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06cd5 expref: 16 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.671362:0:30624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97460924f600/0xcd9d312a94a06d06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06cff expref: 16 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.671368:0:30624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974609396a00/0xcd9d312a94a06d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06d29 expref: 16 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.671375:0:30624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97460924f000/0xcd9d312a94a06d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06d45 expref: 16 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.671381:0:30624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974735f28200/0xcd9d312a94a06d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06d6f expref: 16 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.671389:0:30624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.671439:0:30624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974735f28200/0xcd9d312a94a06d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06d6f expref: 16 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.671695:0:30624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974735f28200/0xcd9d312a94a06d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06d6f expref: 16 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938757.671715:0:30624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342526208:0@lo:104: 00000100:00100000:2.0:1784938757.671944:0:30624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938757.672008:0:30624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97460924f000/0xcd9d312a94a06d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06d45 expref: 16 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.672018:0:30624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97460924f000/0xcd9d312a94a06d4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06d45 expref: 16 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938757.672038:0:30624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342526336:0@lo:104: 00010000:00010000:2.0:1784938757.672063:0:30624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974609396a00/0xcd9d312a94a06d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06d29 expref: 16 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.672071:0:30624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974609396a00/0xcd9d312a94a06d30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06d29 expref: 16 pid: 30625 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938757.672078:0:30624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342526464:0@lo:104: 00010000:00010000:2.0:1784938757.672098:0:30624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97460924f600/0xcd9d312a94a06d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06cff expref: 16 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.672105:0:30624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97460924f600/0xcd9d312a94a06d06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06cff expref: 16 pid: 30624 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938757.672112:0:30624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342526592:0@lo:104: 00010000:00010000:2.0:1784938757.672131:0:30624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974609397600/0xcd9d312a94a06cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06cd5 expref: 16 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.672138:0:30624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974609397600/0xcd9d312a94a06cdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06cd5 expref: 16 pid: 30624 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938757.672145:0:30624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fa300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342526720:0@lo:104: 00000100:00100000:2.0:1784938757.672161:0:30624:0:(client.c:2702:ptlrpc_set_wait()) set ffff974737fbe240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938757.672332:0:30614:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784938757.672355:0:30614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.672381:0:30614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.672389:0:30614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.672397:0:30614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.672420:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342526208 00000100:00100000:3.0:1784938757.672428:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342526208 00000100:00100000:3.0:1784938757.672718:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342526336 00000100:00100000:3.0:1784938757.672722:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342526336 00000100:00100000:3.0:1784938757.672736:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342526464 00000100:00100000:3.0:1784938757.672739:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342526464 00000100:00100000:3.0:1784938757.672748:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342526592 00000100:00100000:2.0:1784938757.673054:0:30613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342526720 00000100:00100000:2.0:1784938757.673060:0:30613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342526720 00000100:00100000:2.0:1784938757.673088:0:30613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784938757.673098:0:30613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703911050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:30624:x1871643342526208:12345-0@lo:104: 00010000:00010000:2.0:1784938757.673129:0:30613:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06d76 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.673276:0:30613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938757.673284:0:30613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703911050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:30624:x1871643342526208:12345-0@lo:104: Request processed in 186us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938757.673293:0:30613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784938757.673341:0:30613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784938757.673348:0:30613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+5:30624:x1871643342526336:12345-0@lo:104: 00010000:00010000:2.0:1784938757.673357:0:30613:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06d4c expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.673392:0:30613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784938757.673398:0:30613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+5:30624:x1871643342526336:12345-0@lo:104: Request processed in 52us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938757.673404:0:30613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784938757.673417:0:30613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784938757.673423:0:30613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+4:30624:x1871643342526464:12345-0@lo:104: 00010000:00010000:2.0:1784938757.673431:0:30613:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06d30 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.673491:0:30613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784938757.673496:0:30613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+4:30624:x1871643342526464:12345-0@lo:104: Request processed in 74us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938757.673503:0:30613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784938757.673526:0:30613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784938757.673533:0:30613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30624:x1871643342526720:12345-0@lo:104: 00010000:00010000:2.0:1784938757.673564:0:30613:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06cdc expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.673595:0:30613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784938757.673600:0:30613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30624:x1871643342526720:12345-0@lo:104: Request processed in 68us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938757.673724:0:30624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342526208:0@lo:104: 00000100:00100000:1.0:1784938757.673735:0:30624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342526336:0@lo:104: 00000100:00100000:1.0:1784938757.673742:0:30624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342526464:0@lo:104: 00000100:00100000:1.0:1784938757.673770:0:30624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fa300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342526720:0@lo:104: 00000100:00100000:3.0:1784938757.673833:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342526592 00010000:00010000:3.0:1784938757.673861:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784938757.673870:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06d76 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.673885:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28400 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938757.673890:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06d76 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.673900:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06d76 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938757.673908:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06d76 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938757.673915:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938757.673962:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d76 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.673969:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938757.673992:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d76 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.673999:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974735f28400/0xcd9d312a94a06d6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d76 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674015:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938757.674018:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06d4c expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674023:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396000 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938757.674026:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06d4c expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674046:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06d4c expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938757.674052:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06d4c expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938757.674058:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938757.674072:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d4c expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674078:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938757.674093:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d4c expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674101:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609396000/0xcd9d312a94a06d45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d4c expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674111:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938757.674115:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06d30 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674121:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924fa00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938757.674124:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06d30 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674130:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06d30 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938757.674137:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06d30 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938757.674149:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938757.674163:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d30 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674168:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938757.674175:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d30 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674181:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460924fa00/0xcd9d312a94a06d29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d30 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674189:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938757.674193:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06cdc expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674199:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01a00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938757.674201:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06cdc expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674208:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06cdc expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938757.674222:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06cdc expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938757.674228:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938757.674242:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06cdc expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674248:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938757.674261:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06cdc expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674268:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06cd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06cdc expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.674278:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938757.674280:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938757.674282:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938757.674291:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938757.674308:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342526848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938757.674357:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.674404:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938757.674410:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342527232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938757.674430:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.674476:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342526976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938757.674505:0:12802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.674522:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938757.674528:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342527104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938757.674549:0:12802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.674580:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342526848 00000100:00100000:3.0:1784938757.674586:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342526848 00000100:00100000:2.0:1784938757.674840:0:30613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784938757.674863:0:30613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784938757.674875:0:30613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30624:x1871643342526592:12345-0@lo:104: 00010000:00010000:2.0:1784938757.674888:0:30613:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06d06 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.674988:0:30613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938757.674994:0:30613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30624:x1871643342526592:12345-0@lo:104: Request processed in 124us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938757.675000:0:30613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1784938757.675064:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974735f28200/0xcd9d312a94a06d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06d6f expref: 17 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938757.675084:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342527232 00000100:00100000:3.0:1784938757.675087:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342527232 00010000:00010000:3.0:1784938757.675100:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974609397600/0xcd9d312a94a06cdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06cd5 expref: 18 pid: 30624 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938757.675126:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342526976 00000100:00100000:3.0:1784938757.675129:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342526976 00010000:00010000:3.0:1784938757.675142:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97460924f000/0xcd9d312a94a06d4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06d45 expref: 19 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938757.675153:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342527104 00000100:00100000:3.0:1784938757.675156:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342527104 00010000:00010000:3.0:1784938757.675167:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974609396a00/0xcd9d312a94a06d30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06d29 expref: 20 pid: 30625 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938757.675179:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784938757.675185:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+20:12805:x1871643342526848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938757.675199:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938757.675205:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974735f28200/0xcd9d312a94a06d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06d6f expref: 20 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.675218:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974735f28200/0xcd9d312a94a06d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06d6f expref: 20 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.675237:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974735f28200/0xcd9d312a94a06d76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06d6f expref: 20 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.675255:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938757.675296:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12805:x1871643342526848:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.675302:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784938757.675316:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784938757.675322:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:12805:x1871643342527232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938757.675343:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938757.675349:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974609397600/0xcd9d312a94a06cdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06cd5 expref: 18 pid: 30624 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.675358:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974609397600/0xcd9d312a94a06cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06cd5 expref: 18 pid: 30624 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.675369:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609397600/0xcd9d312a94a06cdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06cd5 expref: 18 pid: 30624 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.675380:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938757.675403:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:12805:x1871643342527232:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.675411:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784938757.675423:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938757.675430:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:12802:x1871643342526976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938757.675438:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938757.675456:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97460924f000/0xcd9d312a94a06d4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06d45 expref: 16 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.675465:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97460924f000/0xcd9d312a94a06d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06d45 expref: 16 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.675475:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924f000/0xcd9d312a94a06d4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06d45 expref: 16 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.675484:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938757.675512:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:12802:x1871643342526976:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.675527:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938757.675540:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784938757.675546:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:12802:x1871643342527104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938757.675553:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938757.675558:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974609396a00/0xcd9d312a94a06d30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06d29 expref: 14 pid: 30625 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.675567:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974609396a00/0xcd9d312a94a06d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06d29 expref: 14 pid: 30625 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.675577:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609396a00/0xcd9d312a94a06d30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06d29 expref: 14 pid: 30625 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.675587:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938757.675949:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:12802:x1871643342527104:12345-0@lo:103:ldlm_bl.0 Request processed in 403us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.675957:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1784938757.675987:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938757.675995:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06d06 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676002:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29400 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938757.676006:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06d06 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676015:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06d06 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938757.676023:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06d06 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938757.676035:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938757.676077:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d06 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676083:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938757.676098:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d06 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676104:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974735f29400/0xcd9d312a94a06cff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d06 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676120:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938757.676122:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938757.676124:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938757.676156:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342527104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938757.676166:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342526976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938757.676197:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938757.676207:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342527360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938757.676244:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.676285:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342527360 00000100:00100000:3.0:1784938757.676290:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342527360 00010000:00010000:3.0:1784938757.676309:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97460924f600/0xcd9d312a94a06d06 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06cff expref: 13 pid: 30624 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938757.676329:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784938757.676335:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:12804:x1871643342527360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938757.676345:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938757.676361:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97460924f600/0xcd9d312a94a06d06 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06cff expref: 13 pid: 30624 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676370:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97460924f600/0xcd9d312a94a06d06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06cff expref: 13 pid: 30624 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676385:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676394:0:30616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676411:0:30616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676420:0:30616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676427:0:30616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676433:0:30616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676439:0:30616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f200 already unused, calling callback (ffffffffc14344a0) 00000100:00100000:2.0:1784938757.676748:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342527232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938757.676776:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342526848:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938757.676845:0:30616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676855:0:30616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676866:0:30616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.676885:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938757.676966:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:12804:x1871643342527360:12345-0@lo:103:ldlm_bl.0 Request processed in 629us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.676973:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1784938757.677069:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938757.677145:0:30624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924f600/0xcd9d312a94a06d06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06cff expref: 12 pid: 30624 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938757.677157:0:30624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:30624:1871643342526592:0@lo:104: 00010000:00010000:1.0:1784938757.677190:0:30624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.677201:0:30624:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.677206:0:30624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.677220:0:30624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924f200/0xcd9d312a94a06d8b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938757.677237:0:30624:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1784938757.677324:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342527360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938757.748019:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:32268:x1871643342526080:12345-0@lo:253:mount.lustre.0 Request processed in 100782us (102705us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938757.748039:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784938757.748216:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342526080:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784938757.748237:0:32268:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784938757.748242:0:32268:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784938757.748244:0:32268:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938757.748246:0:32268:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938757.748247:0:32268:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1784938757.748248:0:32268:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938757.748249:0:32268:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938757.748251:0:32268:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938757.748252:0:32268:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784938757.748255:0:32268:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938757.748256:0:32268:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784938757.748292:0:32268:0:(tgt_mount.c:101:server_register_mount()) register mount ffff974724c7c800 from lustre-OST0001 10000000:01000000:3.0:1784938757.748328:0:32268:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1784938757.748332:0:32268:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784938757.748343:0:32268:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97473bae19c0 local copy 10000000:01000000:3.0:1784938757.748348:0:32268:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784938757.748397:0:32268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.748411:0:32268:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.748422:0:32268:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938757.748458:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a354380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342527488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938757.748796:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.748922:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff974710412cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938757.749013:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342527488 00000100:00100000:0.0:1784938757.749021:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342527488 00000100:00100000:0.0:1784938757.749117:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784938757.749129:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:32268:x1871643342527488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938757.749146:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938757.749165:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609397200/0xcd9d312a94a06d99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06d92 expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938757.749195:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609397200/0xcd9d312a94a06d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06d92 expref: 12 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938757.749207:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609397200/0xcd9d312a94a06d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06d92 expref: 12 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938757.749218:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609397200, rc 0) 00000100:00100000:0.0:1784938757.749274:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:32268:x1871643342527488:12345-0@lo:101:mount.lustre.0 Request processed in 147us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938757.749281:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784938757.749361:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a354380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342527488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938757.749378:0:32268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcd9d312a94a06d99 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.749388:0:32268:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd9d312a94a06d99 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938757.749974:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342527616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938757.750018:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938757.750356:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474005b600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938757.750473:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342527616 00000100:00100000:3.0:1784938757.750480:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342527616 00000100:00100000:3.0:1784938757.750525:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784938757.750533:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:32268:x1871643342527616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938757.750998:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:32268:x1871643342527616:12345-0@lo:501:mount.lustre.0 Request processed in 464us (978us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784938757.751007:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784938757.751123:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342527616:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784938757.751146:0:32268:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784938757.751289:0:32268:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784938757.751297:0:32268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd9d312a94a06d99 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.751308:0:32268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd9d312a94a06d99 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.751327:0:32268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd9d312a94a06d99 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.751357:0:32268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784938757.751384:0:32268:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff974724c7c800 10000000:01000000:1.0:1784938757.751390:0:32268:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784938757.751396:0:32268:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784938757.751398:0:32268:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938757.751403:0:32268:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1784938757.751407:0:32268:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784938757.751436:0:32268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06da0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.751454:0:32268:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06da0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.751471:0:32268:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06da0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938757.751490:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342527744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938757.751531:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938757.751564:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474005bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938757.751830:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342527744 00000100:00100000:0.0:1784938757.751837:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342527744 00000100:00100000:0.0:1784938757.751871:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784938757.751878:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:32268:x1871643342527744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938757.751888:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938757.751903:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609397800/0xcd9d312a94a06da7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06da0 expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938757.751926:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609397800/0xcd9d312a94a06da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06da0 expref: 13 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938757.751937:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609397800/0xcd9d312a94a06da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06da0 expref: 13 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938757.751947:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609397800, rc 0) 00000100:00100000:0.0:1784938757.751975:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:32268:x1871643342527744:12345-0@lo:101:mount.lustre.0 Request processed in 97us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938757.751980:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:3.0:1784938757.752065:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938757.752072:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd9d312a94a06d99 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.752080:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01a00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938757.752085:0:30619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd9d312a94a06d99 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.752094:0:30619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcd9d312a94a06d99 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938757.752102:0:30619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcd9d312a94a06d99 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938757.752108:0:30619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938757.752131:0:30619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd9d312a94a06d99 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.752137:0:30619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938757.752167:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd9d312a94a06d99 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.752183:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06d92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd9d312a94a06d99 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.752198:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938757.752200:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938757.752201:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938757.752211:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938757.752223:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342527872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938757.752253:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.752286:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342527872 00000100:00100000:3.0:1784938757.752290:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342527872 00000100:00100000:3.0:1784938757.752318:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784938757.752324:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:12803:x1871643342527872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938757.752333:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938757.752346:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609397200/0xcd9d312a94a06d99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a06d92 expref: 13 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.752356:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938757.752377:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:12803:x1871643342527872:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.752383:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784938757.752413:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342527872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938757.752886:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342527744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938757.752907:0:32268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06da0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06da7 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.752918:0:32268:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06da0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06da7 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938757.753181:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938757.753218:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938757.753256:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474005bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938757.753357:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342528000 00000100:00100000:0.0:1784938757.753363:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342528000 00000100:00100000:0.0:1784938757.753397:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784938757.753405:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:32268:x1871643342528000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938757.753852:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:32268:x1871643342528000:12345-0@lo:501:mount.lustre.0 Request processed in 446us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938757.753862:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784938757.754136:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938757.754184:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938757.754233:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938757.754353:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474005bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938757.754561:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342528128 00000100:00100000:2.0:1784938757.754569:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342528128 00000100:00100000:3.0:1784938757.754846:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784938757.754860:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:32268:x1871643342528128:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938757.755132:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:32268:x1871643342528128:12345-0@lo:503:mount.lustre.0 Request processed in 276us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.755146:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784938757.755317:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528128:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784938757.757185:0:32268:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938757.757369:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938757.757546:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938757.758273:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474005bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938757.758359:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342528256 00000100:00100000:2.0:1784938757.758370:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342528256 00000100:00100000:2.0:1784938757.758429:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784938757.758439:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:32268:x1871643342528256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938757.759224:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:32268:x1871643342528256:12345-0@lo:502:mount.lustre.0 Request processed in 782us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938757.759244:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784938757.759386:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938757.760317:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784938757.760389:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1784938757.760419:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1784938757.760734:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1784938757.761045:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1784938757.761088:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1784938757.761154:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938757.761265:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938757.761382:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474005bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938757.761455:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342528384 00000100:00100000:3.0:1784938757.761747:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342528384 00000100:00100000:3.0:1784938757.761846:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784938757.761857:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:32268:x1871643342528384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938757.765567:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:32268:x1871643342528384:12345-0@lo:502:mount.lustre.0 Request processed in 3695us (4286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.765589:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784938757.766813:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784938757.767154:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1784938757.767178:0:32268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1784938757.768340:0:32276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784938757.768352:0:32276:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1784938757.768361:0:32276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938757.768364:0:32276:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1784938757.768372:0:32276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784938757.768412:0:32276:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff974707f28000) 00000020:00000080:2.0:1784938757.768459:0:32276:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784938757.768695:0:32276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784938757.768880:0:32276:0:(tgt_mount.c:153:server_get_mount()) get mount ffff974724c7c800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1784938757.768888:0:32276:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784938757.768896:0:32276:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd9d312a94a06db5 00010000:00010000:3.0:1784938757.775100:0:32276:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1784938757.776081:0:32276:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1784938757.785427:0:32276:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1784938757.786118:0:32276:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1784938757.798395:0:32276:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1784938757.806802:0:32276:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1784938757.818480:0:32276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1784938757.818498:0:32276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938757.818513:0:32276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938757.818515:0:32276:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1784938757.818520:0:32276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938757.818525:0:32276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938757.818526:0:32276:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784938757.818530:0:32276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784938757.818532:0:32276:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784938757.818856:0:32276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938757.818861:0:32276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938757.818862:0:32276:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784938757.818866:0:32276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1784938757.819099:0:32268:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1784938757.819135:0:32268:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784938757.819163:0:32268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06da0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06da7 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.819178:0:32268:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06da0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06da7 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938757.819188:0:32268:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff974724c7c800 from 1 10000000:01000000:3.0:1784938757.819192:0:32268:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938757.819243:0:32268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.819251:0:32268:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.819266:0:32268:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938757.819312:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938757.819406:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.819472:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff974710412900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938757.824486:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342528512 00000100:00100000:3.0:1784938757.824509:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342528512 00000100:00100000:3.0:1784938757.824582:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784938757.824594:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:32268:x1871643342528512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938757.825142:0:30624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938757.825170:0:30624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974741e01800/0xcd9d312a94a06dc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06dbc expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.825204:0:30624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974741e01800/0xcd9d312a94a06dc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06dbc expref: 13 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.825217:0:30624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974741e01800/0xcd9d312a94a06dc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06dbc expref: 13 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.825228:0:30624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01800, rc 0) 00000100:00100000:3.0:1784938757.825348:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:32268:x1871643342528512:12345-0@lo:101:mount.lustre.0 Request processed in 756us (5942us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.825355:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784938757.826398:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938757.826432:0:32268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06dc3 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938757.826456:0:32268:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06dc3 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938757.826658:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938757.826726:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938757.826807:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938757.827436:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342528640 00000100:00100000:1.0:1784938757.827456:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342528640 00000100:00100000:1.0:1784938757.827512:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784938757.827522:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:32268:x1871643342528640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938757.828069:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:32268:x1871643342528640:12345-0@lo:501:mount.lustre.0 Request processed in 546us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938757.828079:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784938757.828936:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938757.829009:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528768:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938757.829108:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938757.829146:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938757.834793:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342528768 00000100:00100000:2.0:1784938757.834815:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342528768 00000100:00100000:2.0:1784938757.834906:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784938757.834919:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:32268:x1871643342528768:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938757.835431:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:32268:x1871643342528768:12345-0@lo:503:mount.lustre.0 Request processed in 512us (6325us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938757.835452:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784938757.835530:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528768:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784938757.835962:0:32268:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784938757.836070:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938757.836136:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938757.836185:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938757.836680:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342528896 00000100:00100000:3.0:1784938757.836690:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342528896 00000100:00100000:3.0:1784938757.836839:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784938757.836849:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:32268:x1871643342528896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938757.840006:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:32268:x1871643342528896:12345-0@lo:502:mount.lustre.0 Request processed in 3143us (3856us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938757.840039:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342528896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784938757.840606:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000100:00100000:3.0:1784938757.841167:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000040:00080000:0.0:1784938757.841455:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1784938757.841520:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342529024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938757.841598:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938757.841654:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938757.841818:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342529024 00000100:00100000:3.0:1784938757.841828:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342529024 00000100:00100000:3.0:1784938757.841890:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784938757.841901:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:32268:x1871643342529024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938757.843397:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:32268:x1871643342529024:12345-0@lo:502:mount.lustre.0 Request processed in 1486us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.843411:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784938757.843455:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342529024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784938757.843647:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784938757.843876:0:32268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1784938757.847005:0:32280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938757.847025:0:32280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938757.847028:0:32280:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784938757.847037:0:32280:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff974724c7c800 00000020:00000080:2.0:1784938757.847040:0:32280:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784938757.847065:0:32280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938757.847068:0:32280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938757.847070:0:32280:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784938757.847073:0:32280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1784938757.847804:0:32268:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784938757.847846:0:32268:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938757.847879:0:32268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06dc3 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.847896:0:32268:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06dc3 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938757.847957:0:32268:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784938757.847961:0:32268:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff974724c7c800 10000000:01000000:1.0:1784938757.847965:0:32268:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff974724c7c800 10000000:01000000:1.0:1784938757.847978:0:32268:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938757.847986:0:32268:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff974724c7c800 from 1 10000000:01000000:1.0:1784938757.847989:0:32268:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938757.848042:0:32268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f28c00/0xcd9d312a94a06dca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.848052:0:32268:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974735f28c00/0xcd9d312a94a06dca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.848067:0:32268:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974735f28c00/0xcd9d312a94a06dca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938757.848100:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342529152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938757.848191:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938757.849062:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718548b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938757.852320:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342529152 00000100:00100000:2.0:1784938757.852341:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342529152 00000100:00100000:2.0:1784938757.852434:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784938757.852658:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:32268:x1871643342529152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938757.852683:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938757.852717:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460924e400/0xcd9d312a94a06dd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06dca expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.852903:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924e400/0xcd9d312a94a06dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06dca expref: 14 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.852986:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460924e400/0xcd9d312a94a06dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06dca expref: 14 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.852998:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924e400, rc 0) 00000100:00100000:2.0:1784938757.853255:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32268:x1871643342529152:12345-0@lo:101:mount.lustre.0 Request processed in 656us (5063us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938757.853264:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784938757.853394:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342529152:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938757.853420:0:32268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974735f28c00/0xcd9d312a94a06dca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06dd1 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.853431:0:32268:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974735f28c00/0xcd9d312a94a06dca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06dd1 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938757.853988:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342529280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938757.854106:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.854195:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff974710412840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938757.854241:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342529280 00000100:00100000:2.0:1784938757.854249:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342529280 00000100:00100000:2.0:1784938757.854325:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784938757.854334:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32268:x1871643342529280:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938757.854944:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32268:x1871643342529280:12345-0@lo:501:mount.lustre.0 Request processed in 607us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938757.854955:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784938757.857844:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342529280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938757.857950:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342529408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938757.858950:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.859017:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff974710412840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938757.860300:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342529408 00000100:00100000:2.0:1784938757.860319:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342529408 00000100:00100000:2.0:1784938757.860483:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784938757.860498:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32268:x1871643342529408:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938757.860881:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32268:x1871643342529408:12345-0@lo:503:mount.lustre.0 Request processed in 387us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938757.860897:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784938757.861078:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342529408:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784938757.861498:0:32268:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784938757.861628:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342529536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938757.861694:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.861741:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff974710412840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938757.861907:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342529536 00000100:00100000:1.0:1784938757.861914:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342529536 00000100:00100000:1.0:1784938757.861963:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784938757.861973:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32268:x1871643342529536:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938757.863138:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32268:x1871643342529536:12345-0@lo:502:mount.lustre.0 Request processed in 1159us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938757.863150:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784938757.863787:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342529536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784938757.864187:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1784938757.864263:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1784938757.864301:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1784938757.864354:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1784938757.864395:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1784938757.864455:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1784938757.864496:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1784938757.864531:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1784938757.864581:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1784938757.865944:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1784938757.866036:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1784938757.866281:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1784938757.866962:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1784938757.867005:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1784938757.867139:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1784938757.867181:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1784938757.867216:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1784938757.867262:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1784938757.867301:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1784938757.867337:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1784938757.867388:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1784938757.867426:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1784938757.870969:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1784938757.871916:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1784938757.871968:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1784938757.872007:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1784938757.877227:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1784938757.877430:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1784938757.877486:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1784938757.877547:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1784938757.877586:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1784938757.877621:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1784938757.877897:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1784938757.877960:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1784938757.878014:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1784938757.878093:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1784938757.878135:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1784938757.878209:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342529664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938757.878561:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938757.878623:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747185486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938757.878695:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342529664 00000100:00100000:0.0:1784938757.878706:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342529664 00000100:00100000:0.0:1784938757.878889:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784938757.878902:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32268:x1871643342529664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938757.880482:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32268:x1871643342529664:12345-0@lo:502:mount.lustre.0 Request processed in 1573us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938757.880499:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784938757.881350:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342529664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938757.881536:0:32268:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1784938757.881556:0:32268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1784938757.885294:0:32281:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1784938757.885320:0:32281:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9747034a99c0) 00000020:00000080:1.0:1784938757.885353:0:32281:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1784938757.885611:0:32281:0:(tgt_mount.c:153:server_get_mount()) get mount ffff974724c7c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784938757.885616:0:32281:0:(tgt_mount.c:187:server_put_mount()) put mount ffff974724c7c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784938757.885620:0:32281:0:(obd_mount.c:706:lustre_put_lsi()) put ffff974724c7c800 3 00010000:00080000:1.0:1784938757.885679:0:32281:0:(ldlm_lib.c:125:import_set_conn()) imp ffff974729ece000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1784938757.898064:0:32281:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1784938757.902596:0:32281:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1784938757.902665:0:32281:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784938757.902687:0:32281:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcd9d312a94a06ddf 00000100:00080000:1.0:1784938757.902707:0:32281:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.202.104@tcp last attempt 0 00000100:00080000:1.0:1784938757.902722:0:32281:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff974729ece000 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:1.0:1784938757.902812:0:32281:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974607d63b80 x1871643342529792/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938757.902845:0:32281:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784938757.903328:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342529792:192.168.202.104@tcp:38:llog_process_th.0 00000100:00100000:1.0:1784938757.904187:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000040:00080000:0.0:1784938757.910352:0:32281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1784938757.910628:0:32283:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff97473a635180 x1871643342529920/t0(0) o901->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lwp_notify_lust.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938757.910644:0:32283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21ad80 going to sleep for 0 seconds 00000100:00100000:3.0:1784938757.911917:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342529792 00000100:00100000:3.0:1784938757.911942:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342529792 00000100:00100000:3.0:1784938757.912004:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00100000:3.0:1784938757.912014:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12801:x1871643342529792:12345-192.168.202.104@tcp:38:llog_process_th.0 00010000:00080000:3.0:1784938757.912174:0:30631:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 911 last 0 00000020:00000080:3.0:1784938757.912239:0:30631:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcd9d312a94a06de6 00000004:00100000:3.0:1784938757.912271:0:30631:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784938757.912361:0:30631:0:(import.c:65:import_set_state_nolock()) ffff97471d974000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938757.913002:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:12801:x1871643342529792:12345-192.168.202.104@tcp:38:llog_process_th.0 Request processed in 983us (8816us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.913014:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 3 00000020:01000000:3.0:1784938757.913094:0:32268:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1784938757.913144:0:32268:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784938757.913180:0:32268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f28c00/0xcd9d312a94a06dca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06dd1 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.913195:0:32268:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974735f28c00/0xcd9d312a94a06dca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06dd1 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784938757.913287:0:32268:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784938757.913296:0:32268:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938757.913298:0:32268:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938757.913300:0:32268:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938757.913301:0:32268:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938757.913303:0:32268:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938757.913305:0:32268:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938757.913307:0:32268:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938757.913308:0:32268:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938757.913310:0:32268:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938757.913311:0:32268:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784938757.913316:0:32268:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1784938757.913319:0:32268:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784938757.913326:0:32268:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938757.913327:0:32268:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938757.913328:0:32268:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938757.913329:0:32268:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938757.913329:0:32268:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938757.913330:0:32268:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938757.913331:0:32268:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938757.913332:0:32268:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938757.913333:0:32268:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938757.913333:0:32268:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784938757.913373:0:32268:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784938757.913403:0:32268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342530048:0@lo:253:mount.lustre.0 00010000:00080000:0.0:1784938757.914063:0:12801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974607d63b80 x1871643342529792/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938757.914082:0:12801:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1784938757.914091:0:32268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784938757.914099:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1784938757.914121:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784938757.914129:0:12801:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784938757.914133:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974729ece000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1784938757.914145:0:12801:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000675c2de6): req@ffff97473a635180 x1871643342529920/t0(0) o901->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lwp_notify_lust.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938757.914154:0:32268:0:(client.c:2702:ptlrpc_set_wait()) set ffff974710412f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938757.914186:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342529792:192.168.202.104@tcp:38:llog_process_th.0 00000100:00100000:0.0:1784938757.914306:0:32283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460a21ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938757.914358:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342530048 00000100:00100000:1.0:1784938757.914366:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342530048 00000100:00100000:1.0:1784938757.914449:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784938757.914460:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32268:x1871643342530048:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784938757.914497:0:30623:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784938757.914514:0:30623:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1784938757.914536:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938757.914611:0:30641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342529920 00000100:00100000:3.0:1784938757.914618:0:30641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342529920 00000100:00100000:3.0:1784938757.914697:0:30641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:3.0:1784938757.914707:0:30641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:32283:x1871643342529920:12345-192.168.202.104@tcp:901:lwp_notify_lust.0 00000100:00100000:3.0:1784938757.915839:0:30641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:32283:x1871643342529920:12345-192.168.202.104@tcp:901:lwp_notify_lust.0 Request processed in 1120us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.915850:0:30641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00080000:3.0:1784938757.915885:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784938757.924968:0:32283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97473a635180 x1871643342529920/t0(0) o901->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:29/10 lens 248/4320 e 0 to 0 dl 1784938773 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lwp_notify_lust.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938757.924995:0:32283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:32283:1871643342529920:192.168.202.104@tcp:901:lwp_notify_lust.0 20000000:01000000:0.0:1784938757.971917:0:30623:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784938757.971943:0:30623:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1784938757.972026:0:30646:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784938757.972033:0:30646:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784938757.972071:0:30646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.972094:0:30646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97460924e200/0xcd9d312a94a06d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06d37 expref: 14 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.972104:0:30646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.972165:0:30646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97460924e200/0xcd9d312a94a06d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06d37 expref: 14 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938757.972185:0:30646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97460924e200/0xcd9d312a94a06d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06d37 expref: 14 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938757.972204:0:30646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:30646:1871643342530176:0@lo:104: 00000100:00100000:2.0:1784938757.972303:0:30646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.972370:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342530176 00000100:00100000:2.0:1784938757.972372:0:30646:0:(client.c:2702:ptlrpc_set_wait()) set ffff974741f5c480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938757.972387:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342530176 00000100:00100000:3.0:1784938757.972470:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784938757.972484:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30646:x1871643342530176:12345-0@lo:104: 00010000:00010000:3.0:1784938757.972505:0:30614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06d3e expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.972617:0:30614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938757.972637:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:30646:x1871643342530176:12345-0@lo:104: Request processed in 157us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.972644:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1784938757.972840:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938757.972847:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06d3e expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.972853:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924e600 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938757.972857:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06d3e expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.972864:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06d3e expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938757.972868:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06d3e expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938757.972872:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938757.972902:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d3e expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.972906:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938757.972920:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d3e expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.972925:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06d37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06d3e expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.972938:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938757.972940:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938757.972941:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938757.972957:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342530304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938757.972989:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938757.973045:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342530304 00000100:00100000:3.0:1784938757.973048:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342530304 00010000:00010000:3.0:1784938757.973062:0:30615:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97460924e200/0xcd9d312a94a06d3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06d37 expref: 15 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938757.973077:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784938757.973081:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97470988ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:12803:x1871643342530304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938757.973088:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938757.973092:0:30615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97460924e200/0xcd9d312a94a06d3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06d37 expref: 15 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.973100:0:30615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97460924e200/0xcd9d312a94a06d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06d37 expref: 15 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.973115:0:30615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.973123:0:30615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784938757.973138:0:30615:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001105753s 00010000:00010000:3.0:1784938757.973142:0:30615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.973149:0:30615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.973156:0:30615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.973173:0:30615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.973178:0:30615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924e800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938757.973182:0:30615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.973189:0:30615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.973511:0:30615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938757.973520:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938757.973565:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97470988ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:12803:x1871643342530304:12345-0@lo:103:ldlm_bl.0 Request processed in 481us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938757.973574:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1784938757.973622:0:30646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924e200/0xcd9d312a94a06d3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06d37 expref: 14 pid: 30623 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938757.973644:0:30646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:30646:1871643342530176:0@lo:104: 00010000:00010000:1.0:1784938757.973681:0:30646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.973693:0:30646:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.973699:0:30646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938757.973706:0:30646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924e800/0xcd9d312a94a06ded lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938757.973877:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342530304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938757.988478:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:32268:x1871643342530048:12345-0@lo:253:mount.lustre.0 Request processed in 74008us (74382us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938757.988493:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784938757.988631:0:32268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:32268:1871643342530048:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784938757.988645:0:32268:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784938757.988647:0:32268:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784938757.988648:0:32268:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938757.988649:0:32268:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938757.988650:0:32268:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938757.988651:0:32268:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938757.988652:0:32268:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938757.988653:0:32268:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938757.988654:0:32268:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938757.988655:0:32268:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938757.988656:0:32268:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938757.988657:0:32268:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784938757.988673:0:32268:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784938757.989983:0:32268:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938757.990411:0:32268:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784938757.990894:0:32268:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938757.991017:0:32268:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784938757.991193:0:32268:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938757.991347:0:32268:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1784938757.992230:0:32268:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1784938758.085323:0:32268:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1784938758.085336:0:32268:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1784938758.085390:0:32268:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784938758.085467:0:32268:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784938758.085484:0:32268:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1784938758.085521:0:32268:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1784938758.457148:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784938759.222857:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784938759.222867:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff974603c37000 from 30 10000000:01000000:3.0:1784938759.222873:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784938759.222935:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a06df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938759.222948:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a06df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938759.222960:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a06df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938759.222987:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a354a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342530432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938759.223058:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938759.223111:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974735bce180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938759.223207:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342530432 00000100:00100000:0.0:1784938759.223214:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342530432 00000100:00100000:0.0:1784938759.223279:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784938759.223289:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342530432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938759.223304:0:30625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938759.223320:0:30625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609397c00/0xcd9d312a94a06dfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06df4 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938759.223342:0:30625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609397c00/0xcd9d312a94a06dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06df4 expref: 14 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938759.223353:0:30625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609397c00/0xcd9d312a94a06dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06df4 expref: 14 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938759.223363:0:30625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609397c00, rc 0) 00000100:00100000:0.0:1784938759.223412:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342530432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938759.223418:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784938759.223481:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a354a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342530432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938759.223518:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a06df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06dfb expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938759.223527:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a06df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06dfb expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938759.223582:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342530560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.223607:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938759.223619:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026db180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938759.223632:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342530560 00000100:00100000:0.0:1784938759.223635:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342530560 00000100:00100000:0.0:1784938759.223654:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784938759.223660:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342530560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.223961:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342530560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938759.223969:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784938759.224000:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342530560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.224027:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342530688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.224067:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938759.224079:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746044f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938759.224091:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342530688 00000100:00100000:0.0:1784938759.224094:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342530688 00000100:00100000:0.0:1784938759.224110:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784938759.224115:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342530688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.224263:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342530688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938759.224279:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784938759.224315:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342530688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.224501:0:32337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32337:1871643342530816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938759.224532:0:32337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938759.224549:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342530816 00000100:00100000:0.0:1784938759.224552:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342530816 00000100:00100000:0.0:1784938759.224569:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784938759.224575:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32337:x1871643342530816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938759.224726:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32337:x1871643342530816:12345-0@lo:502:llog_process_th.0 Request processed in 150us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938759.224733:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784938759.224785:0:32337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026db180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938759.224797:0:32337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32337:1871643342530816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938759.224835:0:32337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32337:1871643342530944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938759.224863:0:32337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938759.224879:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342530944 00000100:00100000:0.0:1784938759.224882:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342530944 00000100:00100000:0.0:1784938759.224901:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784938759.224907:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32337:x1871643342530944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938759.225020:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:32337:x1871643342530944:12345-0@lo:502:llog_process_th.0 Request processed in 113us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938759.225027:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784938759.225054:0:32337:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026db180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938759.225065:0:32337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32337:1871643342530944:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784938759.225089:0:32337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1784938759.225136:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1784938759.225150:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938759.225159:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a06df4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06dfb expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938759.225169:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a06df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06dfb expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938759.225179:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784938759.225182:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1784938759.225185:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784938759.225208:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609397000/0xcd9d312a94a06e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938759.225215:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974609397000/0xcd9d312a94a06e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938759.225224:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974609397000/0xcd9d312a94a06e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938759.225237:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342531072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.225261:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938759.225273:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747187b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938759.225284:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342531072 00000100:00100000:0.0:1784938759.225287:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342531072 00000100:00100000:0.0:1784938759.225307:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784938759.225312:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342531072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938759.225320:0:30625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938759.225338:0:30625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609397a00/0xcd9d312a94a06e09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06e02 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938759.225356:0:30625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609397a00/0xcd9d312a94a06e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06e02 expref: 15 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938759.225365:0:30625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609397a00/0xcd9d312a94a06e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06e02 expref: 15 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938759.225375:0:30625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609397a00, rc 0) 00000100:00100000:0.0:1784938759.225404:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342531072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938759.225410:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784938759.225450:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342531072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938759.225462:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974609397000/0xcd9d312a94a06e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e09 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938759.225471:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974609397000/0xcd9d312a94a06e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06e09 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938759.225505:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342531200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.225526:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938759.225537:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747187b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938759.225547:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342531200 00000100:00100000:0.0:1784938759.225550:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342531200 00000100:00100000:0.0:1784938759.225568:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784938759.225573:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342531200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.225739:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342531200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938759.225773:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784938759.225805:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342531200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.225829:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342531328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.225861:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938759.225873:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747187b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938759.225884:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342531328 00000100:00100000:0.0:1784938759.225887:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342531328 00000100:00100000:0.0:1784938759.225906:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784938759.225912:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342531328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.226075:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342531328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938759.226081:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784938759.226118:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342531328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.239273:0:32338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32338:1871643342531456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938759.239359:0:32338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938759.239415:0:32338:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747187b3240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938759.239483:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342531456 00000100:00100000:1.0:1784938759.239490:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342531456 00000100:00100000:1.0:1784938759.239675:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784938759.239683:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:32338:x1871643342531456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938759.240075:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:32338:x1871643342531456:12345-0@lo:502:llog_process_th.0 Request processed in 392us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938759.240083:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784938759.240173:0:32338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32338:1871643342531456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938759.240210:0:32338:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938759.240220:0:32338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938759.240222:0:32338:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784938759.240227:0:32338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784938759.240229:0:32338:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784938759.240250:0:32338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32338:1871643342531584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938759.240285:0:32338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938759.240315:0:32338:0:(client.c:2702:ptlrpc_set_wait()) set ffff974602662180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938759.240595:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342531584 00000100:00100000:1.0:1784938759.240606:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342531584 00000100:00100000:1.0:1784938759.240642:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784938759.240649:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:32338:x1871643342531584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938759.240818:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:32338:x1871643342531584:12345-0@lo:502:llog_process_th.0 Request processed in 168us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938759.240826:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784938759.240922:0:32338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32338:1871643342531584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938759.240946:0:32338:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938759.240951:0:32338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938759.240953:0:32338:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784938759.240957:0:32338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1784938759.241269:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1784938759.241288:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784938759.241298:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609397000/0xcd9d312a94a06e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e09 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938759.241310:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974609397000/0xcd9d312a94a06e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e09 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938759.241319:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784938759.241322:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9747294ad000 from 30 10000000:01000000:1.0:1784938759.241325:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938759.241350:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938759.241357:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938759.241367:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938759.241382:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342531712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938759.241412:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938759.241459:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474005b540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938759.241578:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342531712 00000100:00100000:2.0:1784938759.241582:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342531712 00000100:00100000:2.0:1784938759.241617:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784938759.241624:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342531712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938759.241633:0:30625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938759.241645:0:30625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460924ee00/0xcd9d312a94a06e17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06e10 expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.241666:0:30625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924ee00/0xcd9d312a94a06e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06e10 expref: 16 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.241677:0:30625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460924ee00/0xcd9d312a94a06e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06e10 expref: 16 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.241685:0:30625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924ee00, rc 0) 00000100:00100000:2.0:1784938759.241716:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342531712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938759.241728:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784938759.241784:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342531712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938759.241797:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.241805:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938759.241846:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342531840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.241869:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938759.241886:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974602662e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938759.241897:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342531840 00000100:00100000:2.0:1784938759.241900:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342531840 00000100:00100000:2.0:1784938759.242109:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784938759.242116:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342531840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.242365:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342531840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938759.242372:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784938759.242398:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342531840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.242424:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342531968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.242468:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938759.242482:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974602662e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938759.242582:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342531968 00000100:00100000:3.0:1784938759.242586:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342531968 00000100:00100000:3.0:1784938759.242609:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784938759.242615:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342531968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938759.242792:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342531968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938759.242799:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784938759.243725:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342531968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.245325:0:32340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32340:1871643342532096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938759.245406:0:32340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938759.245467:0:32340:0:(client.c:2702:ptlrpc_set_wait()) set ffff974602662780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938759.245626:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342532096 00000100:00100000:0.0:1784938759.245633:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342532096 00000100:00100000:0.0:1784938759.245684:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784938759.245694:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:32340:x1871643342532096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938759.246031:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738760c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:32340:x1871643342532096:12345-0@lo:502:llog_process_th.0 Request processed in 337us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938759.246038:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784938759.246334:0:32340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32340:1871643342532096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938759.246393:0:32340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32340:1871643342532224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938759.246441:0:32340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938759.246472:0:32340:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474005b540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938759.248260:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342532224 00000100:00100000:2.0:1784938759.248273:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342532224 00000100:00100000:2.0:1784938759.248338:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784938759.248347:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738763450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:32340:x1871643342532224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938759.248748:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738763450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:32340:x1871643342532224:12345-0@lo:502:llog_process_th.0 Request processed in 400us (2304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938759.248781:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784938759.248886:0:32340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32340:1871643342532224:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784938759.248938:0:32340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1784938759.249058:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1784938759.249077:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784938759.249088:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.249099:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938759.249108:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784938759.249111:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9747294ad000 from 5 10000000:01000000:2.0:1784938759.249114:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784938759.249146:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.249155:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.249164:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938759.249183:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342532352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.249228:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938759.249258:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974602662d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938759.249271:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342532352 00000100:00100000:2.0:1784938759.249275:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342532352 00000100:00100000:2.0:1784938759.249302:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784938759.249309:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342532352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938759.249318:0:30625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938759.249332:0:30625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460924e800/0xcd9d312a94a06e25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06e1e expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.249352:0:30625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924e800/0xcd9d312a94a06e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06e1e expref: 17 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.249363:0:30625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460924e800/0xcd9d312a94a06e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06e1e expref: 17 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.249371:0:30625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924e800, rc 0) 00000100:00100000:2.0:1784938759.249398:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342532352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938759.249404:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784938759.249444:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342532352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938759.249456:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.249465:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938759.249671:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342532480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.249715:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938759.249730:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974602662d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938759.249743:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342532480 00000100:00100000:2.0:1784938759.249776:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342532480 00000100:00100000:2.0:1784938759.249797:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784938759.249803:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342532480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784938759.249817:0:30624:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784938759.249836:0:30624:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784938759.249839:0:30624:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1784938759.249914:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342532480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938759.249921:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784938759.249950:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342532480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784938759.249992:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784938759.249998:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.250006:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938759.250015:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784938759.250017:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1784938759.250020:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784938759.250038:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.250045:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.250064:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938759.250077:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342532608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.250101:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938759.250120:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974602662d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938759.250131:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342532608 00000100:00100000:2.0:1784938759.250134:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342532608 00000100:00100000:2.0:1784938759.250150:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784938759.250156:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738761450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342532608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938759.250163:0:30624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938759.250174:0:30624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460924f200/0xcd9d312a94a06e33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06e2c expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.250189:0:30624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460924f200/0xcd9d312a94a06e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06e2c expref: 18 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.250198:0:30624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460924f200/0xcd9d312a94a06e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06e2c expref: 18 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.250205:0:30624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924f200, rc 0) 00000100:00100000:2.0:1784938759.250231:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738761450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342532608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938759.250237:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784938759.250263:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342532608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938759.250273:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.250287:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938759.250330:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342532736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.250354:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938759.250367:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974602662d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938759.250378:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342532736 00000100:00100000:2.0:1784938759.250381:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342532736 00000100:00100000:2.0:1784938759.250399:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784938759.250404:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342532736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.251076:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342532736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 668us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938759.251084:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784938759.252145:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342532736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.252209:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a636680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342532864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938759.252266:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938759.252303:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746044f5600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938759.252365:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342532864 00000100:00100000:2.0:1784938759.252371:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342532864 00000100:00100000:2.0:1784938759.252416:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784938759.252425:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342532864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.252858:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342532864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 433us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938759.252866:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784938759.253289:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a636680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342532864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938759.253829:0:32341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32341:1871643342532992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938759.253885:0:32341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938759.254016:0:32341:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746044f5600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938759.254073:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342532992 00000100:00100000:2.0:1784938759.254079:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342532992 00000100:00100000:2.0:1784938759.254119:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784938759.254127:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:32341:x1871643342532992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938759.254375:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:32341:x1871643342532992:12345-0@lo:502:llog_process_th.0 Request processed in 249us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938759.254389:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784938759.254572:0:32341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32341:1871643342532992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938759.254602:0:32341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784938759.254609:0:32341:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784938759.254615:0:32341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938759.254618:0:32341:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784938759.254624:0:32341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784938759.254627:0:32341:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:1.0:1784938759.254652:0:32341:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784938759.254656:0:32341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938759.254672:0:32341:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff974602f60000) 00000020:00000080:1.0:1784938759.254693:0:32341:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1784938759.254698:0:32341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784938759.254804:0:32341:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1784938759.254811:0:32341:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784938759.254819:0:32341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a06e41 00010000:00080000:1.0:1784938759.254860:0:32341:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9746022e5800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1784938759.255233:0:32341:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1784938759.255830:0:32341:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1784938759.255844:0:32341:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784938759.256355:0:32341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938759.256796:0:32341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938759.256870:0:32341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1784938759.256948:0:32341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000020:00000080:3.0:1784938759.259792:0:32341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938759.259810:0:32341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784938759.259849:0:32341:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784938759.259875:0:32341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a06e48 00000100:00080000:3.0:1784938759.259889:0:32341:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.202.104@tcp last attempt 0 00000100:00080000:3.0:1784938759.259901:0:32341:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9746022e5800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:3.0:1784938759.259946:0:32341:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97460a356680 x1871643342533120/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938759.259973:0:32341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784938759.260031:0:32341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938759.260036:0:32341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938759.260038:0:32341:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784938759.260040:0:32341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938759.260045:0:32341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938759.260047:0:32341:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784938759.260049:0:32341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784938759.260051:0:32341:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784938759.260080:0:32341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32341:1871643342533248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938759.260151:0:32341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938759.260186:0:32341:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747409d6900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938759.260250:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342533120:192.168.202.104@tcp:8:llog_process_th.0 00000100:00100000:0.0:1784938759.260335:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342533248 00000100:00100000:0.0:1784938759.260342:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342533248 00000100:00100000:0.0:1784938759.260381:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784938759.260390:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:32341:x1871643342533248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938759.260658:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:32341:x1871643342533248:12345-0@lo:502:llog_process_th.0 Request processed in 268us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938759.260666:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784938759.261155:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938759.261189:0:32341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:32341:1871643342533248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938759.261215:0:32341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938759.261220:0:32341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938759.261228:0:32341:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784938759.261233:0:32341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1784938759.261614:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342533120 00000100:00100000:0.0:1784938759.261620:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342533120 00000100:00100000:0.0:1784938759.261655:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00100000:0.0:1784938759.261661:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:12801:x1871643342533120:12345-192.168.202.104@tcp:8:llog_process_th.0 00010000:00080000:0.0:1784938759.261686:0:31428:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 913 last 0 00000020:00000080:0.0:1784938759.261711:0:31428:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a06e4f 00002000:00100000:0.0:1784938759.261721:0:31428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9747360ae000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784938759.261725:0:31428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1784938759.261728:0:31428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1784938759.261864:0:31428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784938759.262116:0:31428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784938759.262146:0:31428:0:(import.c:65:import_set_state_nolock()) ffff9747360ad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938759.262196:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:12801:x1871643342533120:12345-192.168.202.104@tcp:8:llog_process_th.0 Request processed in 533us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938759.262215:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 4 00010000:00080000:0.0:1784938759.262349:0:12801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97460a356680 x1871643342533120/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938759.262360:0:12801:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938759.262368:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784938759.262375:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784938759.262380:0:12801:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784938759.262382:0:12801:0:(import.c:65:import_set_state_nolock()) ffff9746022e5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784938759.262391:0:12801:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784938759.262396:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342533120:192.168.202.104@tcp:8:llog_process_th.0 00000040:00080000:3.0:1784938759.263763:0:32342:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938759.263771:0:32342:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1784938759.263807:0:32342:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784938759.263918:0:32342:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913101165500ns, next at 0ns, rc = 0 00000020:01000000:2.0:1784938759.264726:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1784938759.264784:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784938759.264798:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.264811:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938759.264822:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784938759.264825:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97473bae19c0 from 1 10000000:01000000:2.0:1784938759.264828:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784938759.264865:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924f600/0xcd9d312a94a06e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.264874:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460924f600/0xcd9d312a94a06e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.264885:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460924f600/0xcd9d312a94a06e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938759.264912:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342533376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.264985:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938759.265033:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974602662c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938759.265797:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342533376 00000100:00100000:3.0:1784938759.265807:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342533376 00000100:00100000:3.0:1784938759.265854:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784938759.265863:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342533376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938759.265880:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938759.265897:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974741e00e00/0xcd9d312a94a06e5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a06e56 expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938759.265925:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974741e00e00/0xcd9d312a94a06e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a06e56 expref: 19 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938759.265937:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974741e00e00/0xcd9d312a94a06e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06e56 expref: 19 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938759.265946:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e00e00, rc 0) 00000100:00100000:3.0:1784938759.266001:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342533376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938759.266008:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784938759.267101:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342533760:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938759.267190:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938759.267198:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342533888:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938759.267416:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938759.267456:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938759.267483:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342533760 00000100:00100000:1.0:1784938759.267490:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342533760 00000100:00100000:1.0:1784938759.271190:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:1.0:1784938759.271206:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342533760:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938759.271289:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342533760:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 86us (3872us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938759.271297:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:1.0:1784938759.271330:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342533888 00000100:00100000:1.0:1784938759.271337:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342533888 00000100:00100000:1.0:1784938759.271366:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 11 00000100:00100000:1.0:1784938759.271372:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12802:x1871643342533888:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938759.271396:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12802:x1871643342533888:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 25us (3940us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938759.271403:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 11 00000100:00080000:3.0:1784938759.272606:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938759.272613:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938759.272828:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342533632:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938759.272898:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938759.272907:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342533504:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938759.275542:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938759.275568:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938759.275595:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342533632 00000100:00100000:0.0:1784938759.275603:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342533632 00000100:00100000:0.0:1784938759.275657:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342533504 00000100:00100000:0.0:1784938759.275661:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342533504 00000100:00100000:0.0:1784938759.275680:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 12 00000100:00100000:0.0:1784938759.275688:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342533632:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938759.275779:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342533632:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 90us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938759.275787:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 12 00000100:00100000:0.0:1784938759.275817:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 13 00000100:00100000:0.0:1784938759.275824:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342533504:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938759.275850:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342533504:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 27us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938759.275856:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 13 00000100:00080000:0.0:1784938759.275871:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784938759.277615:0:12805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974607d62680 x1871643342533504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938759.277634:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342533504:192.168.202.104@tcp:400:kworker.0 00010000:00080000:0.0:1784938759.277649:0:12805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974607d61880 x1871643342533632/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938759.277659:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342533632:192.168.202.104@tcp:400:kworker.0 00010000:00080000:1.0:1784938759.278130:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974607d61c00 x1871643342533888/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938759.278159:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342533888:192.168.202.104@tcp:400:kworker.0 00010000:00080000:1.0:1784938759.278179:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974607d62a00 x1871643342533760/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938759.278188:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342533760:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938759.278600:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342533376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938759.278623:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460924f600/0xcd9d312a94a06e56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e5d expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.278646:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460924f600/0xcd9d312a94a06e56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06e5d expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938759.278713:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342534016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.278802:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938759.278834:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974602662c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938759.278850:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342534016 00000100:00100000:2.0:1784938759.278856:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342534016 00000100:00100000:2.0:1784938759.278896:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784938759.278904:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342534016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938759.279130:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342534016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (327us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938759.279138:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784938759.279194:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342534016:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784938759.279217:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784938759.279225:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924f600/0xcd9d312a94a06e56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e5d expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938759.279233:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460924f600/0xcd9d312a94a06e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e5d expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938759.320253:0:30612:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1784938759.320333:0:32343:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1784938759.320370:0:32343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a357b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32343:1871643342534272:192.168.202.104@tcp:7:osp-pre-1-0.0 00000100:00100000:3.0:1784938759.320725:0:32343:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bc480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938759.320745:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342534144:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938759.330225:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938759.330625:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938759.330719:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342534144 00000100:00100000:1.0:1784938759.330729:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342534144 00000100:00100000:1.0:1784938759.330810:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00100000:1.0:1784938759.330820:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:12804:x1871643342534144:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938759.330859:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 390070272 avail 387973120 00000100:00100000:1.0:1784938759.330923:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:12804:x1871643342534144:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 104us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938759.330931:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00080000:3.0:1784938759.330991:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784938759.331276:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97460a355500 x1871643342534144/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938759.331297:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342534144:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938759.331397:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342534272 00000100:00100000:2.0:1784938759.331403:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342534272 00000100:00100000:2.0:1784938759.331455:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:2.0:1784938759.331463:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:32343:x1871643342534272:12345-192.168.202.104@tcp:7:osp-pre-1-0.0 00002000:00080000:3.0:1784938759.348250:0:31427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1784938759.348258:0:31427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1784938759.348339:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:32343:x1871643342534272:12345-192.168.202.104@tcp:7:osp-pre-1-0.0 Request processed in 16872us (18121us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938759.348349:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 5 00010000:00080000:2.0:1784938759.349120:0:32343:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97460a357b80 x1871643342534272/t0(0) o7->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:28/4 lens 264/240 e 0 to 0 dl 1784938775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938759.349137:0:32343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a357b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32343:1871643342534272:192.168.202.104@tcp:7:osp-pre-1-0.0 00000004:00080000:2.0:1784938759.349150:0:32343:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1784938759.349191:0:32343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32343:1871643342534400:192.168.202.104@tcp:5:osp-pre-1-0.0 00000100:00100000:2.0:1784938759.349247:0:32343:0:(client.c:2702:ptlrpc_set_wait()) set ffff974602662d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938759.349320:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938759.349344:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342534400 00000100:00100000:2.0:1784938759.349350:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342534400 00000100:00100000:2.0:1784938759.349394:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 6 00000100:00100000:2.0:1784938759.349403:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:32343:x1871643342534400:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 00002000:00080000:2.0:1784938759.349440:0:31428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1784938759.349444:0:31428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1784938759.351174:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:32343:x1871643342534400:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 Request processed in 1766us (1849us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1784938759.351185:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 6 00010000:00080000:2.0:1784938759.351683:0:32343:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9747358f9f80 x1871643342534400/t0(0) o5->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938759.351700:0:32343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32343:1871643342534400:192.168.202.104@tcp:5:osp-pre-1-0.0 00000004:00080000:2.0:1784938759.351713:0:32343:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1784938759.352091:0:32343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32343:1871643342534528:192.168.202.104@tcp:700:osp-pre-1-0.0 00000100:00100000:2.0:1784938759.352149:0:32343:0:(client.c:2702:ptlrpc_set_wait()) set ffff974602662d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938759.352580:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938759.352638:0:31434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342534528 00000100:00100000:1.0:1784938759.352646:0:31434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342534528 00000100:00100000:1.0:1784938759.352696:0:31434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:1.0:1784938759.352704:0:31434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:32343:x1871643342534528:12345-192.168.202.104@tcp:700:osp-pre-1-0.0 00000100:00100000:1.0:1784938759.352745:0:31434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d62a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:31434:1871643342534656:192.168.202.104@tcp:700:ll_ost_seq00_00.0 00000100:00100000:1.0:1784938759.352809:0:31434:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470610ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938759.352918:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938759.353019:0:30637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342534656 00000100:00100000:1.0:1784938759.353028:0:30637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342534656 00000100:00100000:1.0:1784938759.353060:0:30637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:1.0:1784938759.353066:0:30637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:31434:x1871643342534656:12345-192.168.202.104@tcp:700:ll_ost_seq00_00.0 40000000:02000000:1.0:1784938759.427150:0:30637:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1784938759.436786:0:30637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:31434:x1871643342534656:12345-192.168.202.104@tcp:700:ll_ost_seq00_00.0 Request processed in 83709us (83858us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938759.436804:0:30637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 1 00010000:00080000:1.0:1784938759.437184:0:31434:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974607d62a00 x1871643342534656/t0(0) o700->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:32/10 lens 264/248 e 0 to 0 dl 1784938775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_ost_seq00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938759.437199:0:31434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d62a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:31434:1871643342534656:192.168.202.104@tcp:700:ll_ost_seq00_00.0 40000000:02000000:1.0:1784938759.437222:0:31434:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:0.0:1784938759.477741:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784938759.501836:0:32270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784938759.501859:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1784938759.502013:0:31434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:32343:x1871643342534528:12345-192.168.202.104@tcp:700:osp-pre-1-0.0 Request processed in 149302us (149507us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938759.502025:0:31434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 1 00010000:00080000:3.0:1784938759.506243:0:32343:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9747358fb100 x1871643342534528/t0(0) o700->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:31/4 lens 264/248 e 0 to 0 dl 1784938775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938759.506260:0:32343:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784938759.506281:0:32343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32343:1871643342534528:192.168.202.104@tcp:700:osp-pre-1-0.0 00000004:02000040:0.0:1784938759.533569:0:32343:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1784938759.537482:0:32343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a636680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32343:1871643342534784:192.168.202.104@tcp:5:osp-pre-1-0.0 00000100:00100000:0.0:1784938759.537647:0:32343:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747056e9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938759.549933:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938759.550175:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342534784 00000100:00100000:2.0:1784938759.550185:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342534784 00000100:00100000:2.0:1784938759.550241:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 7 00000100:00100000:2.0:1784938759.550251:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:32343:x1871643342534784:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 00002000:00080000:3.0:1784938759.558198:0:31427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1784938759.558221:0:31427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 2 00002000:00080000:3.0:1784938759.559246:0:31427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 10 00000001:00080000:3.0:1784938759.560077:0:31427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967298 00002000:00080000:3.0:1784938759.560172:0:31427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 18 00000001:00080000:2.0:1784938759.561160:0:31427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967299 00002000:00080000:2.0:1784938759.561269:0:31427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 26 00000001:00080000:3.0:1784938759.562182:0:31427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967300 00000100:00100000:3.0:1784938759.562385:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:32343:x1871643342534784:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 Request processed in 12131us (12458us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784938759.562396:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 7 00000020:00080000:3.0:1784938759.562407:0:31427:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00010000:00080000:0.0:1784938759.562843:0:32343:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97473a636680 x1871643342534784/t0(0) o5->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938759.562861:0:32343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a636680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32343:1871643342534784:192.168.202.104@tcp:5:osp-pre-1-0.0 00000004:00080000:0.0:1784938759.562877:0:32343:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1784938760.499823:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938761.524438:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938762.547593:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938762.619694:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938762.619719:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342534912:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938762.620020:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938762.620050:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342534912 00000100:00100000:2.0:1784938762.620058:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342534912 00000100:00100000:2.0:1784938762.620115:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:2.0:1784938762.620126:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342534912:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938762.620161:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 390070272 avail 387973120 00000100:00100000:2.0:1784938762.620198:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342534912:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 74us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938762.620205:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00080000:2.0:1784938762.620224:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784938762.620823:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9747358f8a80 x1871643342534912/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938762.620846:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342534912:192.168.202.104@tcp:13:osp-pre-0-0.0 00010000:00010000:2.0:1784938763.571194:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938764.594951:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938764.660198:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342535040:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938764.660500:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938764.660531:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342535040 00000100:00100000:0.0:1784938764.660538:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342535040 00000100:00100000:0.0:1784938764.660604:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 6 00000100:00100000:0.0:1784938764.660614:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:12802:x1871643342535040:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938764.660654:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 390070272 avail 387973120 00000100:00100000:0.0:1784938764.660700:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:12802:x1871643342535040:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 88us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938764.660708:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 6 00000100:00080000:0.0:1784938764.660731:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938764.663086:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342535296:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938764.663184:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938764.663191:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342535424:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938764.663481:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938764.663541:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938764.665321:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342535296 00000100:00100000:0.0:1784938764.665338:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342535296 00000100:00100000:0.0:1784938764.671045:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342535424 00000100:00100000:0.0:1784938764.671058:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342535424 00000100:00100000:0.0:1784938764.671121:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 14 00000100:00100000:0.0:1784938764.671131:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342535296:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938764.671211:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342535296:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 83us (7732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938764.671219:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 14 00000100:00100000:0.0:1784938764.671234:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 15 00000100:00100000:0.0:1784938764.671240:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342535424:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938764.671277:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342535424:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 37us (7737us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938764.671283:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 15 00000100:00100000:0.0:1784938764.671320:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342535168:0@lo:400:kworker.0 00000100:00100000:0.0:1784938764.671372:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938764.671433:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342535680:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938764.671479:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938764.671487:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342535552:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938764.671520:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342535168 00000100:00100000:0.0:1784938764.671524:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342535168 00000100:00100000:0.0:1784938764.671554:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784938764.671561:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342535168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938764.671599:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342535168:12345-0@lo:400:kworker.0 Request processed in 39us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938764.671606:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784938764.671838:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938764.671863:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00010000:00080000:0.0:1784938764.671933:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97473a637800 x1871643342535040/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938764.671958:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342535040:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938764.671992:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342535168:0@lo:400:kworker.0 00000100:00100000:0.0:1784938764.672009:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342535680 00000100:00100000:0.0:1784938764.672012:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342535680 00000100:00100000:0.0:1784938764.672048:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 16 00000100:00100000:0.0:1784938764.672054:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342535680:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938764.672087:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342535680:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 32us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938764.672094:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 16 00010000:00080000:0.0:1784938764.672190:0:12803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97460a357100 x1871643342535680/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938764.672199:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342535680:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938764.675581:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342535552 00000100:00100000:2.0:1784938764.675601:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342535552 00000100:00100000:2.0:1784938764.675696:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00100000:2.0:1784938764.675715:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342535552:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938764.675827:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342535552:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 113us (3961us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938764.675835:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00080000:3.0:1784938764.676729:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938764.676737:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784938764.676806:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97460a357480 x1871643342535424/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938764.676823:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342535424:192.168.202.104@tcp:400:kworker.0 00010000:00080000:3.0:1784938764.676839:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97460a355880 x1871643342535296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938764.676847:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342535296:192.168.202.104@tcp:400:kworker.0 00010000:00080000:2.0:1784938764.684057:0:12803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97460a354000 x1871643342535552/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938764.684079:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342535552:192.168.202.104@tcp:400:kworker.0 00000001:00080000:2.0:1784938764.773000:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1784938765.622586:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784938765.689668:0:32632:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784938766.644384:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938767.668065:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938767.730942:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342535808:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938767.731306:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938767.731384:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342535808 00000100:00100000:3.0:1784938767.731393:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342535808 00000100:00100000:3.0:1784938767.731468:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 7 00000100:00100000:3.0:1784938767.731478:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342535808:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938767.731521:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 390070272 avail 387973120 00000100:00100000:3.0:1784938767.731574:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342535808:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 96us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938767.731581:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 7 00010000:00080000:3.0:1784938767.731710:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9747358f8a80 x1871643342535808/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938767.731731:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342535808:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00080000:0.0:1784938767.731976:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784938768.691364:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938769.715295:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938769.779137:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342535936:0@lo:400:kworker.0 00000100:00100000:3.0:1784938769.779222:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938769.779282:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:12805:1871643342536448:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938769.779362:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938769.779368:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342536320:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938769.779551:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342535936 00000100:00100000:1.0:1784938769.779558:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342535936 00000100:00100000:1.0:1784938769.779602:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784938769.779610:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12805:x1871643342535936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938769.779662:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12805:x1871643342535936:12345-0@lo:400:kworker.0 Request processed in 53us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938769.779668:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784938769.780039:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938769.780132:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938769.780157:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342536448 00000100:00100000:3.0:1784938769.780162:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342536448 00000100:00100000:3.0:1784938769.780204:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 17 00000100:00100000:3.0:1784938769.780211:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12805:x1871643342536448:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938769.780247:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12805:x1871643342536448:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 36us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938769.780254:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 17 00000100:00100000:3.0:1784938769.780273:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342536320 00000100:00100000:3.0:1784938769.780276:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342536320 00000100:00100000:3.0:1784938769.780300:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00100000:3.0:1784938769.780306:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342536320:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938769.780336:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342536320:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 30us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938769.780369:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00080000:3.0:1784938769.780389:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938769.780394:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938769.781589:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342536064:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938769.781645:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342536576:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938769.781673:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784938769.781679:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342536192:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938769.781705:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342536704:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938769.788237:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938769.788275:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938769.788298:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938769.788318:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938769.788361:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342536576 00000100:00100000:1.0:1784938769.788383:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342536576 00000100:00100000:2.0:1784938769.788553:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342536064 00000100:00100000:2.0:1784938769.788559:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342536064 00000100:00100000:2.0:1784938769.788592:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342536192 00000100:00100000:2.0:1784938769.788595:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342536192 00000100:00100000:2.0:1784938769.788616:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 18 00000100:00100000:2.0:1784938769.788625:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342536064:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938769.788698:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342536064:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 73us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938769.788706:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 18 00000100:00100000:2.0:1784938769.788724:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 19 00000100:00100000:2.0:1784938769.788739:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342536192:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938769.788796:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342536192:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 58us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938769.788802:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 19 00000100:00100000:1.0:1784938769.788869:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:1.0:1784938769.788878:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342536576:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938769.788907:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342536576:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 31us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938769.788913:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:1.0:1784938769.788933:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342536704 00000100:00100000:1.0:1784938769.788937:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342536704 00000100:00100000:1.0:1784938769.788972:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 8 00000100:00100000:1.0:1784938769.788979:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342536704:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938769.789010:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 390070272 avail 387973120 00000100:00100000:1.0:1784938769.789038:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342536704:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 60us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938769.789045:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 8 00000100:00080000:1.0:1784938769.789060:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938769.789064:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784938769.789877:0:12805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974607d60000 x1871643342536320/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938769.789895:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342536320:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938769.789909:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342535936:0@lo:400:kworker.0 00010000:00080000:1.0:1784938769.790587:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974607d60a80 x1871643342536192/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938769.790600:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342536192:192.168.202.104@tcp:400:kworker.0 00010000:00080000:1.0:1784938769.790613:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97473a635f80 x1871643342536704/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938769.790621:0:12802:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000100:00100000:1.0:1784938769.790640:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342536704:192.168.202.104@tcp:13:osp-pre-1-0.0 00010000:00080000:1.0:1784938769.790653:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974607d61c00 x1871643342536064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938769.790679:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342536064:192.168.202.104@tcp:400:kworker.0 00010000:00080000:1.0:1784938769.790692:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974607d63100 x1871643342536576/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938769.790699:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342536576:192.168.202.104@tcp:400:kworker.0 00010000:00080000:0.0:1784938769.790937:0:12805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974607d62d80 x1871643342536448/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938769.790947:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:12805:1871643342536448:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938770.480476:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938770.480688:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326033024 00000100:00100000:2.0:1784938770.480699:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326033024 00000100:00100000:2.0:1784938770.480784:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:2.0:1784938770.480794:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:10022:x1871643326033024:12345-192.168.202.4@tcp:250:mount.lustre.0 00010000:00080000:2.0:1784938770.480823:0:30625:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from 003631c3-aab2-48e6-bdb2-de6019261408@192.168.202.4@tcp t0 exp 0000000000000000 cur 924 last 0 00000020:00000080:2.0:1784938770.480864:0:30625:0:(genops.c:1406:class_connect()) connect: client 003631c3-aab2-48e6-bdb2-de6019261408, cookie 0xcd9d312a94a06e64 00000100:00080000:2.0:1784938770.480997:0:30625:0:(import.c:65:import_set_state_nolock()) ffff97473c932800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938770.481061:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+5:10022:x1871643326033024:12345-192.168.202.4@tcp:250:mount.lustre.0 Request processed in 267us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938770.481069:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:3.0:1784938770.503353:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938770.503678:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326033152 00000100:00100000:1.0:1784938770.503689:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326033152 00000100:00100000:1.0:1784938770.503805:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:1.0:1784938770.503815:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+5:24537:x1871643326033152:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784938770.504115:0:30624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938770.504135:0:30624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974735f28200/0xcd9d312a94a06e6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5481 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938770.504224:0:30624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974735f28200/0xcd9d312a94a06e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5481 expref: 6 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938770.504237:0:30624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974735f28200/0xcd9d312a94a06e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5481 expref: 6 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938770.504246:0:30624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f28200, rc 0) 00000100:00100000:1.0:1784938770.504313:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+6:24537:x1871643326033152:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 499us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938770.504320:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:0.0:1784938770.535956:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938770.543607:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326033280 00000100:00100000:1.0:1784938770.543621:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326033280 00000100:00100000:1.0:1784938770.543767:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 115 00000100:00100000:1.0:1784938770.543778:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+6:24537:x1871643326033280:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784938770.544081:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+6:24537:x1871643326033280:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 304us (8132us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784938770.544088:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 115 00000100:00100000:2.0:1784938770.557605:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938770.559812:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326033408 00000100:00100000:1.0:1784938770.559829:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326033408 00000100:00100000:1.0:1784938770.559912:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 116 00000100:00100000:1.0:1784938770.559924:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+6:24537:x1871643326033408:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784938770.559940:0:30624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938770.559960:0:30624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974735f28400/0xcd9d312a94a06e72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5488 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938770.559989:0:30624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974735f28400/0xcd9d312a94a06e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5488 expref: 7 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938770.560001:0:30624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974735f28400/0xcd9d312a94a06e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5488 expref: 7 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938770.560011:0:30624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f28400, rc 0) 00000100:00100000:1.0:1784938770.560066:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+7:24537:x1871643326033408:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 144us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938770.560072:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 116 00000100:00100000:3.0:1784938770.574701:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938770.579783:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326033536 00000100:00100000:1.0:1784938770.579799:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326033536 00000100:00100000:1.0:1784938770.579880:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 117 00000100:00100000:1.0:1784938770.579890:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+7:24537:x1871643326033536:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784938770.580249:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+8:24537:x1871643326033536:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 359us (5557us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938770.580258:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 117 00000100:00100000:0.0:1784938770.583808:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938770.583962:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326033664 00000100:00100000:2.0:1784938770.583973:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326033664 00000100:00100000:2.0:1784938770.584020:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:2.0:1784938770.584029:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+8:24537:x1871643326033664:12345-192.168.202.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784938770.584423:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+8:24537:x1871643326033664:12345-192.168.202.4@tcp:503:mount.lustre.0 Request processed in 393us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938770.584432:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:3.0:1784938770.588254:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938770.588418:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326033792 00000100:00100000:0.0:1784938770.588432:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326033792 00000100:00100000:0.0:1784938770.588516:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:0.0:1784938770.588546:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+8:24552:x1871643326033792:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938770.589030:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+8:24552:x1871643326033792:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 485us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938770.589040:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:3.0:1784938770.625624:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938770.625791:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326033920 00000100:00100000:0.0:1784938770.625806:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326033920 00000100:00100000:0.0:1784938770.625884:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:0.0:1784938770.625895:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704e06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+8:24552:x1871643326033920:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938770.626287:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704e06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+8:24552:x1871643326033920:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 391us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938770.626297:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:3.0:1784938770.653634:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938770.654432:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326034048 00000100:00100000:1.0:1784938770.654449:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326034048 00000100:00100000:1.0:1784938770.654529:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:1.0:1784938770.654539:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+8:24537:x1871643326034048:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784938770.654556:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938770.654576:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974735f28000/0xcd9d312a94a06e79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d54b2 expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938770.654605:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974735f28000/0xcd9d312a94a06e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54b2 expref: 9 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938770.654617:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974735f28000/0xcd9d312a94a06e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54b2 expref: 9 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938770.654626:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f28000, rc 0) 00000100:00100000:1.0:1784938770.654709:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+9:24537:x1871643326034048:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 171us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938770.654717:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:3.0:1784938770.666058:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938770.667162:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326034176 00000100:00100000:2.0:1784938770.667174:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326034176 00000100:00100000:2.0:1784938770.667253:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:2.0:1784938770.667262:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974736698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+9:24537:x1871643326034176:12345-192.168.202.4@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784938770.667296:0:30625:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784938770.667313:0:30625:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784938770.667317:0:30625:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784938770.667320:0:30625:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784938770.667322:0:30625:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1784938770.672206:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974736698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+9:24537:x1871643326034176:12345-192.168.202.4@tcp:256:mount.lustre.0 Request processed in 4935us (6149us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938770.672221:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:3.0:1784938770.687151:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938770.687353:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326034304 00000100:00100000:0.0:1784938770.687375:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326034304 00000100:00100000:0.0:1784938770.687458:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:0.0:1784938770.687470:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+9:24537:x1871643326034304:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784938770.687493:0:30624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938770.687516:0:30624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609396c00/0xcd9d312a94a06e80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d54b9 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938770.687552:0:30624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609396c00/0xcd9d312a94a06e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54b9 expref: 10 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938770.687566:0:30624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609396c00/0xcd9d312a94a06e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54b9 expref: 10 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938770.687579:0:30624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609396c00, rc 0) 00000100:00100000:0.0:1784938770.687676:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+10:24537:x1871643326034304:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 207us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938770.687683:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:3.0:1784938770.696939:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938770.697185:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326034432 00000100:00100000:2.0:1784938770.697205:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326034432 00000100:00100000:2.0:1784938770.697291:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00100000:2.0:1784938770.697302:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+10:24537:x1871643326034432:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784938770.697639:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+10:24537:x1871643326034432:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 337us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938770.697648:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00100000:3.0:1784938770.710400:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938770.710666:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326034560 00000100:00100000:1.0:1784938770.710683:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326034560 00000100:00100000:1.0:1784938770.710795:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:1.0:1784938770.710808:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+10:24537:x1871643326034560:12345-192.168.202.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784938770.711212:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+10:24537:x1871643326034560:12345-192.168.202.4@tcp:503:mount.lustre.0 Request processed in 406us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938770.711242:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:3.0:1784938770.714876:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938770.719382:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326034688 00000100:00100000:2.0:1784938770.719397:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326034688 00000100:00100000:2.0:1784938770.719466:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 126 00000100:00100000:2.0:1784938770.719476:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+10:24558:x1871643326034688:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938770.719826:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+10:24558:x1871643326034688:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 350us (4964us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938770.719836:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 126 00000100:00100000:3.0:1784938770.738405:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1784938770.744644:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938770.744848:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326034816 00000100:00100000:0.0:1784938770.744863:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326034816 00000100:00100000:0.0:1784938770.745922:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 127 00000100:00100000:0.0:1784938770.745942:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+10:24558:x1871643326034816:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938770.746607:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+10:24558:x1871643326034816:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 670us (8228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938770.746618:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 127 00000100:00100000:3.0:1784938770.753866:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938770.754889:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326034944 00000100:00100000:1.0:1784938770.754916:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326034944 00000100:00100000:1.0:1784938770.754992:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:1.0:1784938770.755003:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:10022:x1871643326034944:12345-192.168.202.4@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784938770.755046:0:30632:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp t0 exp 0000000000000000 cur 924 last 0 00000020:00000080:1.0:1784938770.755320:0:30632:0:(genops.c:1406:class_connect()) connect: client 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1, cookie 0xcd9d312a94a06e87 00000004:00100000:1.0:1784938770.755498:0:30632:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1784938770.755507:0:30632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1784938770.824858:0:30632:0:(import.c:65:import_set_state_nolock()) ffff97473b75e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938770.827306:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:10022:x1871643326034944:12345-192.168.202.4@tcp:38:mount.lustre.0 Request processed in 72290us (73443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938770.827324:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:3.0:1784938770.832983:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938770.833041:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938770.833392:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326035072 00000100:00100000:0.0:1784938770.833416:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326035072 00000100:00100000:0.0:1784938770.833518:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326035200 00000100:00100000:0.0:1784938770.833522:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326035200 00000100:00100000:0.0:1784938770.833544:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:0.0:1784938770.833558:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:0:x1871643326035072:12345-192.168.202.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784938770.833638:0:30631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 390725632 avail 388628480 00000100:00080000:3.0:1784938770.834069:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938770.836665:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:0:x1871643326035072:12345-192.168.202.4@tcp:41:mount.lustre.0 Request processed in 3099us (3684us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938770.836680:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:0.0:1784938770.836721:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:0.0:1784938770.836735:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:24537:x1871643326035200:12345-192.168.202.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784938770.836788:0:30631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 390725632 avail 388628480 00000100:00100000:0.0:1784938770.836814:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:24537:x1871643326035200:12345-192.168.202.4@tcp:41:mount.lustre.0 Request processed in 86us (3772us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938770.836836:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:2.0:1784938770.857278:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938770.857376:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326035328 00000100:00100000:1.0:1784938770.857392:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326035328 00000100:00100000:1.0:1784938770.857472:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:1.0:1784938770.857485:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:24537:x1871643326035328:12345-192.168.202.4@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784938770.857599:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:24537:x1871643326035328:12345-192.168.202.4@tcp:40:mount.lustre.0 Request processed in 116us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938770.857606:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:3.0:1784938770.878453:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938770.878511:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938770.878545:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938770.878589:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938770.878639:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326035840 00000100:00100000:3.0:1784938770.878653:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326035840 00000100:00100000:3.0:1784938770.878720:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 128 00000100:00100000:3.0:1784938770.878733:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+10:10023:x1871643326035840:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784938770.878893:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+10:10023:x1871643326035840:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 162us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938770.878923:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 128 00000100:00100000:1.0:1784938770.878963:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326035456 00000100:00100000:1.0:1784938770.878979:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326035456 00000100:00100000:1.0:1784938770.879040:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326035584 00000100:00100000:1.0:1784938770.879043:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326035584 00000100:00100000:1.0:1784938770.879067:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:1.0:1784938770.879076:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:10022:x1871643326035456:12345-192.168.202.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784938770.879128:0:31428:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp t0 exp 0000000000000000 cur 924 last 0 00000020:00000080:1.0:1784938770.879162:0:31428:0:(genops.c:1406:class_connect()) connect: client 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1, cookie 0xcd9d312a94a06e8e 00002000:00100000:1.0:1784938770.879174:0:31428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1/ffff97473b75a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784938770.879201:0:31428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938770.879542:0:31428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784938770.879574:0:31428:0:(import.c:65:import_set_state_nolock()) ffff97473b758800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938770.879648:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:10022:x1871643326035456:12345-192.168.202.4@tcp:8:mount.lustre.0 Request processed in 572us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938770.879656:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:1.0:1784938770.879676:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:1.0:1784938770.879681:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:10022:x1871643326035584:12345-192.168.202.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784938770.879696:0:31428:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp t0 exp 0000000000000000 cur 924 last 0 00000020:00000080:1.0:1784938770.879712:0:31428:0:(genops.c:1406:class_connect()) connect: client 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1, cookie 0xcd9d312a94a06e95 00002000:00100000:1.0:1784938770.879718:0:31428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1/ffff97473b75b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784938770.879724:0:31428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938770.879987:0:31428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784938770.880004:0:31428:0:(import.c:65:import_set_state_nolock()) ffff97473b75e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938770.880035:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:10022:x1871643326035584:12345-192.168.202.4@tcp:8:mount.lustre.0 Request processed in 351us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938770.880043:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:0.0:1784938770.880064:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326035712 00000100:00100000:0.0:1784938770.880077:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326035712 00000100:00100000:0.0:1784938770.880152:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:0.0:1784938770.880162:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:24537:x1871643326035712:12345-192.168.202.4@tcp:33:mount.lustre.0 00000004:00080000:1.0:1784938770.883981:0:30633:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3726us 00000004:00200000:3.0:1784938770.924961:0:30633:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1784938770.926922:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:24537:x1871643326035712:12345-192.168.202.4@tcp:33:mount.lustre.0 Request processed in 46748us (48473us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938770.926945:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:3.0:1784938771.206378:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938771.206502:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326035968 00000100:00100000:1.0:1784938771.206520:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326035968 00000100:00100000:1.0:1784938771.206607:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:1.0:1784938771.206632:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:24575:x1871643326035968:12345-192.168.202.4@tcp:101:mkdir.0 00010000:00010000:1.0:1784938771.206654:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938771.206731:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29600/0xcd9d312a94a06e9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d54e3 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938771.206851:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a06ea3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938771.206866:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a06ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938771.206883:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a06ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938771.207077:0:30630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784938771.207082:0:30630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784938771.207170:0:30630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a06ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938771.207200:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29600/0xcd9d312a94a06e9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54e3 expref: 8 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938771.207216:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a06ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54e3 expref: 7 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938771.207226:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97473635ec00) 00010000:00010000:1.0:1784938771.207229:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938771.207233:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29a00, rc 0) 00000100:00100000:1.0:1784938771.207304:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:24575:x1871643326035968:12345-192.168.202.4@tcp:101:mkdir.0 Request processed in 674us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938771.207321:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00010000:00010000:0.0:1784938771.769986:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938772.787246:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938772.859224:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342536832:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938772.862544:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938772.862594:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342536832 00000100:00100000:3.0:1784938772.862605:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342536832 00000100:00100000:3.0:1784938772.862681:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 9 00000100:00100000:3.0:1784938772.862695:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342536832:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938772.862746:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 390070272 avail 387973120 00000100:00100000:3.0:1784938772.862845:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342536832:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 154us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938772.862854:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 9 00000100:00080000:3.0:1784938772.862878:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784938772.885078:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9747358fbb80 x1871643342536832/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938772.885118:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342536832:192.168.202.104@tcp:13:osp-pre-0-0.0 00000001:00100000:1.0:1784938772.923871:0:31424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1 00000100:00100000:3.0:1784938773.326513:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938773.326640:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326036096 00000100:00100000:0.0:1784938773.326651:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326036096 00000100:00100000:0.0:1784938773.326738:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:0.0:1784938773.326748:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:24628:x1871643326036096:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:0.0:1784938773.326825:0:30631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 390725632 avail 388628480 00000100:00100000:0.0:1784938773.326918:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:24628:x1871643326036096:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 170us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938773.326926:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00080000:3.0:1784938773.327004:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938773.333915:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938773.334494:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326036224 00000100:00100000:1.0:1784938773.334509:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326036224 00000100:00100000:1.0:1784938773.334595:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:1.0:1784938773.334606:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+5:24628:x1871643326036224:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:1.0:1784938773.334637:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 390070272 avail 387973120 00000100:00100000:1.0:1784938773.334739:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+5:24628:x1871643326036224:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 133us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938773.334747:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00080000:3.0:1784938773.338128:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938773.343711:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938773.343846:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326036352 00000100:00100000:1.0:1784938773.343856:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326036352 00000100:00100000:1.0:1784938773.343926:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:1.0:1784938773.343936:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:24628:x1871643326036352:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:1.0:1784938773.343979:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 390070272 avail 387973120 00000100:00100000:1.0:1784938773.344067:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:24628:x1871643326036352:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 132us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938773.344074:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00080000:3.0:1784938773.344174:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784938773.817010:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938774.842838:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938774.899401:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342537088:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938774.899514:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342537600:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938774.899562:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938774.899585:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342537216:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938774.899851:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938774.899908:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938774.899931:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938774.899974:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342537600 00000100:00100000:3.0:1784938774.899981:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342537600 00000100:00100000:3.0:1784938774.900039:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 6 00000100:00100000:3.0:1784938774.900048:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342537600:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938774.900274:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342536960:0@lo:400:kworker.0 00000100:00100000:1.0:1784938774.900323:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938774.900350:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:12805:1871643342537472:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938774.900384:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938774.900391:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342537344:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938774.901032:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342536960 00000100:00100000:0.0:1784938774.901038:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342536960 00000100:00100000:0.0:1784938774.901075:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1784938774.901083:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12805:x1871643342536960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938774.901128:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12805:x1871643342536960:12345-0@lo:400:kworker.0 Request processed in 46us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938774.901136:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784938774.901263:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473a635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342537728:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938774.901281:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342537600:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 1234us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938774.901290:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 6 00000100:00100000:3.0:1784938774.901324:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342537088 00000100:00100000:3.0:1784938774.901328:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342537088 00000100:00100000:3.0:1784938774.901363:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342537216 00000100:00100000:3.0:1784938774.901366:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342537216 00000100:00100000:3.0:1784938774.901384:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 20 00000100:00100000:3.0:1784938774.901390:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342537088:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938774.901417:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342537088:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 27us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938774.901423:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 20 00000100:00100000:3.0:1784938774.901434:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 21 00000100:00100000:3.0:1784938774.901440:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342537216:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938774.901462:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342537216:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 21us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938774.901467:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 21 00000100:00080000:3.0:1784938774.901486:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938774.901495:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938774.901552:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342536960:0@lo:400:kworker.0 00000100:00100000:0.0:1784938774.901628:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938774.901666:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938774.901695:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342537472 00000100:00100000:0.0:1784938774.901696:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938774.901698:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342537472 00000100:00100000:3.0:1784938774.901724:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 22 00000100:00100000:3.0:1784938774.901730:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12805:x1871643342537472:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938774.901740:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342537216:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938774.901771:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342537088:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938774.901773:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12805:x1871643342537472:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 43us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938774.901779:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 22 00000100:00080000:3.0:1784938774.901792:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938774.901881:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:12805:1871643342537472:192.168.202.104@tcp:400:kworker.0 00010000:00080000:0.0:1784938774.902983:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97472fc89f80 x1871643342537600/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938774.903012:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342537600:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938774.904250:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342537344 00000100:00100000:1.0:1784938774.904262:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342537344 00000100:00100000:1.0:1784938774.904352:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 7 00000100:00100000:1.0:1784938774.904362:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342537344:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938774.904428:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342537344:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 68us (2761us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938774.904435:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 7 00000100:00100000:1.0:1784938774.904460:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342537728 00000100:00100000:1.0:1784938774.904464:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342537728 00000100:00100000:1.0:1784938774.904490:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 12 00000100:00100000:1.0:1784938774.904496:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342537728:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938774.904511:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 390070272 avail 387973120 00000100:00100000:1.0:1784938774.904536:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342537728:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 39us (2839us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938774.904542:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 12 00010000:00080000:0.0:1784938774.905454:0:12805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97472fc88e00 x1871643342537344/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938774.905470:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342537344:192.168.202.104@tcp:400:kworker.0 00010000:00080000:1.0:1784938774.906500:0:12803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97473a635f80 x1871643342537728/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938774.906524:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473a635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342537728:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00080000:3.0:1784938774.909149:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1784938774.950600:0:32270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1 00010000:00010000:0.0:1784938775.860096:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784938776.001405:0:30612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1 00000100:00100000:0.0:1784938776.181547:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938776.181592:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938776.181630:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938776.181658:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938776.181692:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326036736 00000100:00100000:0.0:1784938776.181702:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326036736 00000100:00100000:0.0:1784938776.181790:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326036864 00000100:00100000:0.0:1784938776.181794:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326036864 00000100:00100000:0.0:1784938776.181818:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:0.0:1784938776.181828:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+5:10023:x1871643326036736:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784938776.181899:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+5:10023:x1871643326036736:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 73us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938776.181921:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:0.0:1784938776.181939:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:0.0:1784938776.181945:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+5:10023:x1871643326036864:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1784938776.181974:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+5:10023:x1871643326036864:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938776.181979:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:1.0:1784938776.182161:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326036608 00000100:00100000:1.0:1784938776.182166:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326036608 00000100:00100000:1.0:1784938776.182212:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:1.0:1784938776.182219:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:10025:x1871643326036608:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938776.182256:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:10025:x1871643326036608:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 38us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938776.182269:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:3.0:1784938776.185428:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326036480 00000100:00100000:3.0:1784938776.185444:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326036480 00000100:00100000:3.0:1784938776.185641:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 130 00000100:00100000:3.0:1784938776.185652:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+10:10025:x1871643326036480:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784938776.185805:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+10:10025:x1871643326036480:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 152us (4265us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938776.185814:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 130 00000100:00080000:3.0:1784938776.185857:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938776.185862:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938776.185865:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1784938776.301180:0:32892:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1784938776.883194:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938777.910254:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938777.972886:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342537856:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938777.973598:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938777.973630:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342537856 00000100:00100000:0.0:1784938777.973638:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342537856 00000100:00100000:0.0:1784938777.973697:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 13 00000100:00100000:0.0:1784938777.973706:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342537856:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938777.973744:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 390070272 avail 387973120 00000100:00100000:0.0:1784938777.973813:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342537856:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 107us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938777.973821:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 13 00000100:00080000:0.0:1784938777.973844:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784938777.975369:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974607d62a00 x1871643342537856/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938777.975478:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342537856:192.168.202.104@tcp:13:osp-pre-0-0.0 00010000:00010000:1.0:1784938778.933310:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938779.955506:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938780.019217:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342537984:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938780.019581:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938780.019998:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342538368:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938780.020062:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938780.020069:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342538496:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938780.020116:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:12803:1871643342538240:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938780.020143:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784938780.020149:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342538112:0@lo:400:kworker.0 00000100:00100000:1.0:1784938780.020183:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938780.020212:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342538624:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938780.021910:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342537984 00000100:00100000:1.0:1784938780.021927:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342537984 00000100:00100000:1.0:1784938780.022025:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 14 00000100:00080000:3.0:1784938780.022029:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938780.022041:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342537984:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938780.022084:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 390070272 avail 387973120 00000100:00100000:1.0:1784938780.022225:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342537984:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 189us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938780.022233:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 14 00000100:00100000:0.0:1784938780.023580:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938780.023617:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938780.023664:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938780.023685:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938780.023730:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342538112 00000100:00100000:0.0:1784938780.023737:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342538112 00000100:00100000:0.0:1784938780.023797:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784938780.023806:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342538112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938780.023861:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342538112:12345-0@lo:400:kworker.0 Request processed in 57us (3678us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938780.023868:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784938780.023927:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342538368 00000100:00100000:0.0:1784938780.023931:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342538368 00000100:00100000:0.0:1784938780.023958:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342538240 00000100:00100000:0.0:1784938780.023961:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342538240 00000100:00100000:0.0:1784938780.023971:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342538624 00000100:00100000:0.0:1784938780.023974:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342538624 00000100:00100000:0.0:1784938780.023988:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 24 00000100:00100000:0.0:1784938780.023994:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342538368:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938780.024037:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342538368:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 42us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938780.024043:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 24 00000100:00100000:0.0:1784938780.024055:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 25 00000100:00100000:0.0:1784938780.024061:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12803:x1871643342538240:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938780.024089:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12803:x1871643342538240:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938780.024461:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342538496 00000100:00100000:3.0:1784938780.024474:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342538496 00000100:00100000:3.0:1784938780.024551:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 10 00000100:00100000:3.0:1784938780.024569:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342538496:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938780.024571:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 25 00000100:00100000:0.0:1784938780.024600:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 26 00000100:00100000:0.0:1784938780.024610:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342538624:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938780.024670:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342538496:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 102us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938780.024681:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342538624:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 64us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938780.024691:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 10 00000100:00100000:0.0:1784938780.024701:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 26 00000100:00080000:3.0:1784938780.024727:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938780.024749:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784938780.027459:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974735402680 x1871643342538496/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938780.027481:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342538496:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938780.027497:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342538368:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938780.027542:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342538112:0@lo:400:kworker.0 00000100:00100000:0.0:1784938780.027611:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342538624:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938780.027624:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:12803:1871643342538240:192.168.202.104@tcp:400:kworker.0 00010000:00080000:2.0:1784938780.028006:0:12805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974735401880 x1871643342537984/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938780.028024:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342537984:192.168.202.104@tcp:13:osp-pre-1-0.0 00000020:00000080:1.0:1784938780.536620:0:33040:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1ac43960 20000000:00000080:1.0:1784938780.536640:0:33040:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff974601396000 uarg=0000000000000000 20000000:01000000:1.0:1784938780.536680:0:33040:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784938780.536692:0:33040:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784938780.536697:0:33040:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1784938780.538419:0:33041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1784938780.538600:0:33040:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1784938780.544687:0:33040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1784938780.545476:0:33040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1784938780.545545:0:33040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1784938780.545565:0:33040:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784938780.545587:0:33040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938780.545605:0:33040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974735f29e00/0xcd9d312a94a06c96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06c8f expref: 18 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938780.545613:0:33040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97460924f800/0xcd9d312a94a06cf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06cf1 expref: 18 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938780.545620:0:33040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974741e01800/0xcd9d312a94a06dc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a06dbc expref: 18 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938780.545644:0:33040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974609396c00/0xcd9d312a94a06e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54b9 expref: 9 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938780.545654:0:33040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938780.545697:0:33040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974609396c00/0xcd9d312a94a06e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54b9 expref: 9 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938780.545714:0:33040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974609396c00/0xcd9d312a94a06e80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54b9 expref: 9 pid: 30624 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938780.545730:0:33040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33040:1871643342538752:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938780.546091:0:33040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974741e01800/0xcd9d312a94a06dc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06dbc expref: 18 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938780.546100:0:33040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974741e01800/0xcd9d312a94a06dc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06dbc expref: 18 pid: 30624 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938780.546110:0:33040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33040:1871643342538880:0@lo:104: 00000100:00100000:0.0:1784938780.546150:0:33040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938780.546192:0:33040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97460924f800/0xcd9d312a94a06cf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06cf1 expref: 18 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938780.546201:0:33040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97460924f800/0xcd9d312a94a06cf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06cf1 expref: 18 pid: 30625 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938780.546210:0:33040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33040:1871643342539008:0@lo:104: 00000100:00100000:0.0:1784938780.546242:0:33040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938780.546284:0:33040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974735f29e00/0xcd9d312a94a06c96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a06c8f expref: 18 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938780.546292:0:33040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974735f29e00/0xcd9d312a94a06c96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a06c8f expref: 18 pid: 30623 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938780.546300:0:33040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33040:1871643342539136:0@lo:104: 00000100:00100000:0.0:1784938780.546316:0:33040:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938780.546446:0:30614:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784938780.546466:0:30614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938780.546479:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342538880 00000100:00100000:3.0:1784938780.546485:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342538880 00000100:00100000:3.0:1784938780.546525:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342539008 00000100:00100000:3.0:1784938780.546528:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342539008 00000100:00100000:3.0:1784938780.546539:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342539136 00000100:00100000:3.0:1784938780.546541:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342539136 00000100:00100000:3.0:1784938780.546555:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938780.546563:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+5:33040:x1871643342538880:12345-0@lo:104: 00010000:00010000:3.0:1784938780.546577:0:30614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06dc3 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.546644:0:30614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938780.546651:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+5:33040:x1871643342538880:12345-0@lo:104: Request processed in 89us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938780.546658:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938780.546676:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784938780.546683:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601e19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+4:33040:x1871643342539008:12345-0@lo:104: 00010000:00010000:3.0:1784938780.546692:0:30614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06cf8 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.546738:0:30614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784938780.546776:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601e19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+4:33040:x1871643342539008:12345-0@lo:104: Request processed in 68us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938780.546783:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784938780.546819:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784938780.546826:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:33040:x1871643342539136:12345-0@lo:104: 00010000:00010000:3.0:1784938780.546834:0:30614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06c96 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.546866:0:30614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784938780.546871:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:33040:x1871643342539136:12345-0@lo:104: Request processed in 46us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938780.546878:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1784938780.546895:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938780.546902:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06dc3 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.546909:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01a00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938780.546912:0:30619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06dc3 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.546920:0:30619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06dc3 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938780.546927:0:30619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06dc3 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938780.546933:0:30619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938780.546961:0:30619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06dc3 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.546979:0:30619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938780.547002:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06dc3 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547008:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a06dbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06dc3 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547020:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938780.547023:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06cf8 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547029:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28a00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938780.547031:0:30619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06cf8 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547038:0:30619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06cf8 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938780.547044:0:30619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06cf8 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938780.547049:0:30619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938780.547062:0:30619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06cf8 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547068:0:30619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938780.547085:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06cf8 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547091:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974735f28a00/0xcd9d312a94a06cf1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06cf8 expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547105:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938780.547108:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a06c96 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547113:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29c00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:3.0:1784938780.547116:0:30619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a06c96 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547121:0:30619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a06c96 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938780.547127:0:30619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a06c96 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938780.547131:0:30619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938780.547143:0:30619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c96 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547148:0:30619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938780.547153:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c96 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547159:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974735f29c00/0xcd9d312a94a06c8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a06c96 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547170:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938780.547172:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938780.547173:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938780.547192:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342539264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938780.547228:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938780.547286:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342539392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938780.547312:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938780.547343:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938780.547348:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342539520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938780.547372:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938780.547398:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342539264 00000100:00100000:3.0:1784938780.547402:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342539264 00010000:00010000:3.0:1784938780.547423:0:30615:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974741e01800/0xcd9d312a94a06dc3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06dbc expref: 19 pid: 30624 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938780.547438:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342539392 00000100:00100000:3.0:1784938780.547440:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342539392 00010000:00010000:3.0:1784938780.547450:0:30615:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97460924f800/0xcd9d312a94a06cf8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06cf1 expref: 20 pid: 30625 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938780.547460:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342539520 00000100:00100000:3.0:1784938780.547462:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342539520 00010000:00010000:3.0:1784938780.547472:0:30615:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974735f29e00/0xcd9d312a94a06c96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06c8f expref: 21 pid: 30623 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938780.547482:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938780.547487:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+21:12803:x1871643342539264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938780.547496:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938780.547500:0:30615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974741e01800/0xcd9d312a94a06dc3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06dbc expref: 21 pid: 30624 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547509:0:30615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974741e01800/0xcd9d312a94a06dc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06dbc expref: 21 pid: 30624 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547537:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938780.547564:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+21:12803:x1871643342539264:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938780.547570:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938780.547584:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784938780.547590:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+20:12804:x1871643342539392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938780.547597:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938780.547601:0:30615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97460924f800/0xcd9d312a94a06cf8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06cf1 expref: 20 pid: 30625 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547608:0:30615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97460924f800/0xcd9d312a94a06cf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06cf1 expref: 20 pid: 30625 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547616:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938780.547642:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+20:12804:x1871643342539392:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938780.547648:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784938780.547660:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784938780.547666:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12804:x1871643342539520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938780.547673:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938780.547676:0:30615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974735f29e00/0xcd9d312a94a06c96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a06c8f expref: 19 pid: 30623 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547683:0:30615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974735f29e00/0xcd9d312a94a06c96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a06c8f expref: 19 pid: 30623 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.547692:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938780.547719:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12804:x1871643342539520:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938780.547725:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784938780.547793:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342539264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938780.547820:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342539520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938780.547827:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f55f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342539392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938780.548066:0:33040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974741e01800/0xcd9d312a94a06dc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06dbc expref: 18 pid: 30624 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938780.548077:0:33040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33040:1871643342538880:0@lo:104: 00010000:00010000:0.0:1784938780.548086:0:33040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924f800/0xcd9d312a94a06cf8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06cf1 expref: 17 pid: 30625 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938780.548092:0:33040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33040:1871643342539008:0@lo:104: 00010000:00010000:0.0:1784938780.548099:0:33040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974735f29e00/0xcd9d312a94a06c96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a06c8f expref: 16 pid: 30623 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938780.548105:0:33040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33040:1871643342539136:0@lo:104: 00010000:00010000:1.0:1784938780.548166:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938780.548172:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938780.562414:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938780.563447:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326036992 00000100:00100000:3.0:1784938780.563461:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326036992 00010000:00010000:3.0:1784938780.563507:0:30615:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974609396c00/0xcd9d312a94a06e80 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54b9 expref: 10 pid: 30624 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938780.563544:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:3.0:1784938780.563554:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:003631c3-aab2-48e6-bdb2-de6019261408+10:10026:x1871643326036992:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938780.563572:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938780.563578:0:30615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974609396c00/0xcd9d312a94a06e80 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54b9 expref: 10 pid: 30624 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.563594:0:30615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974609396c00/0xcd9d312a94a06e80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54b9 expref: 10 pid: 30624 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.563619:0:30615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.563628:0:30615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.563646:0:30615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.563671:0:30615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.563677:0:30615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.563684:0:30615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.563690:0:30615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938780.563694:0:30615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.563703:0:30615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.563712:0:30615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938780.563722:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938780.563806:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:003631c3-aab2-48e6-bdb2-de6019261408+10:10026:x1871643326036992:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 253us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938780.563814:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00010000:00010000:2.0:1784938780.564618:0:33040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609396c00/0xcd9d312a94a06e80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54b9 expref: 9 pid: 30624 timeout: 1034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938780.564636:0:33040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33040:1871643342538752:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938780.564666:0:33040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.564675:0:33040:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.564681:0:33040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.564686:0:33040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609396000/0xcd9d312a94a06eaa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938780.929390:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938780.929799:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326037120 00000100:00100000:3.0:1784938780.929816:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326037120 00000100:00080000:0.0:1784938780.929865:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938780.929964:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:2.0:1784938780.929978:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:21521:x1871643326037120:12345-192.168.202.4@tcp:37:bash.0 00000100:00100000:2.0:1784938780.940679:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:21521:x1871643326037120:12345-192.168.202.4@tcp:37:bash.0 Request processed in 10691us (11290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938780.940709:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:0.0:1784938780.970332:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938780.970447:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326037248 00000100:00100000:1.0:1784938780.970459:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326037248 00000100:00100000:1.0:1784938780.970524:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:1.0:1784938780.970534:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:25026:x1871643326037248:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:1.0:1784938780.970555:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938780.970577:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29600/0xcd9d312a94a06eb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d54ea expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.971400:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a06eb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.971418:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a06eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.971433:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a06eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.971493:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a06ebf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.971501:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a06ebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.971508:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a06ebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974087:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a06eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974110:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a06eb8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974119:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a06eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974126:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938780.974131:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a06eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974139:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a06eb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974156:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97473635ec00) 00010000:00010000:1.0:1784938780.974159:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938780.974164:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a06eb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974170:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a06eb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974184:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a06ebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974190:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a06ebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974197:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a06ebf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974202:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938780.974209:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a06ebf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974216:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a06ebf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974223:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xceb91eaa (ffff97473635e200) 00010000:00010000:1.0:1784938780.974226:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938780.974228:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a06ebf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974234:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a06ebf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xceb91eaa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974290:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29600/0xcd9d312a94a06eb1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54ea expref: 7 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974301:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97473635ec00) 00010000:00010000:1.0:1784938780.974303:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938780.974306:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29600/0xcd9d312a94a06eb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54ea expref: 7 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938780.974316:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29600, rc 0) 00000100:00100000:1.0:1784938780.974402:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:25026:x1871643326037248:12345-192.168.202.4@tcp:101:rm.0 Request processed in 3868us (4079us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938780.974411:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00010000:00010000:3.0:1784938780.978951:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938780.995081:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938780.995197:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326037376 00000100:00100000:2.0:1784938780.995217:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326037376 00000100:00100000:2.0:1784938780.995284:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:2.0:1784938780.995295:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:25027:x1871643326037376:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1784938780.995317:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938780.995342:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06ec6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d54f1 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995407:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06ecd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995423:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06ecd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995434:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06ecd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995451:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06ed4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995458:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995465:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995711:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06ecd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995732:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06ecd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995740:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06ecd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995746:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924fe00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938780.995797:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06ecd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995814:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06ecd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995829:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97473635ec00) 00010000:00010000:2.0:1784938780.995833:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938780.995839:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06ecd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995844:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06ecd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995859:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995864:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995869:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.995874:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924fa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938780.996381:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.996388:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.996397:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc82c34f8 (ffff974705272900) 00010000:00010000:2.0:1784938780.996400:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938780.996403:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06ed4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.996409:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06ed4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.996453:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06ec6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54f1 expref: 7 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.996464:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97473635ec00) 00010000:00010000:2.0:1784938780.996466:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938780.996470:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06ec6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54f1 expref: 7 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938780.996479:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924f400, rc 0) 00000100:00100000:2.0:1784938780.996659:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:25027:x1871643326037376:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1363us (1587us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938780.996667:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:2.0:1784938781.004291:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.004566:0:30639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326037504 00000100:00100000:1.0:1784938781.004576:0:30639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326037504 00000100:00100000:1.0:1784938781.004634:0:30639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:1.0:1784938781.004644:0:30639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:25027:x1871643326037504:12345-192.168.202.4@tcp:700:lfs.0 00000100:00100000:1.0:1784938781.004792:0:30639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:25027:x1871643326037504:12345-192.168.202.4@tcp:700:lfs.0 Request processed in 148us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.004799:0:30639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:1.0:1784938781.007565:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.007680:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326037760 00000100:00100000:0.0:1784938781.007690:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326037760 00000100:00100000:0.0:1784938781.007789:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:0.0:1784938781.007801:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:25027:x1871643326037760:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:0.0:1784938781.008193:0:30631:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938781.008225:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a06ea3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54e3 expref: 6 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.008244:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97473635ec00) 00010000:00010000:0.0:1784938781.008266:0:30631:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938781.008542:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609396a00/0xcd9d312a94a06edb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.008557:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609396a00/0xcd9d312a94a06edb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.008566:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609396a00/0xcd9d312a94a06edb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.008578:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609396e00/0xcd9d312a94a06ee2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.008584:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609396e00/0xcd9d312a94a06ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.008590:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609396e00/0xcd9d312a94a06ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938781.010503:0:30631:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1784938781.010520:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609396a00/0xcd9d312a94a06edb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.010530:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609396a00/0xcd9d312a94a06edb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.010536:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609396a00/0xcd9d312a94a06edb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.010549:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938781.010554:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609396a00/0xcd9d312a94a06edb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.010562:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609396a00/0xcd9d312a94a06edb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.010576:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974607c00b00) 00010000:00010000:0.0:1784938781.010579:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.010584:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609396a00/0xcd9d312a94a06edb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.010590:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609396a00/0xcd9d312a94a06edb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938781.010608:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057dbb203 reply state 000000006f684f64 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff974609396e00/0xcd9d312a94a06ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.010617:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938781.010729:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:25027:x1871643326037760:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 2926us (3172us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784938781.010738:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00010000:00010000:3.0:1784938781.017616:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609396e00/0xcd9d312a94a06ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.017637:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609396e00/0xcd9d312a94a06ee2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.018220:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609396e00/0xcd9d312a94a06ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.018227:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.018232:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609396e00/0xcd9d312a94a06ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.018241:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609396e00/0xcd9d312a94a06ee2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.018275:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc82c34f8 (ffff974607c00e00) 00010000:00010000:3.0:1784938781.018279:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.018285:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609396e00/0xcd9d312a94a06ee2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.018292:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609396e00/0xcd9d312a94a06ee2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.049016:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.049097:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326037888 00000100:00100000:2.0:1784938781.049108:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326037888 00000100:00100000:2.0:1784938781.049171:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:2.0:1784938781.049189:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:21521:x1871643326037888:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1784938781.049213:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.049236:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06ee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d54f8 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.049319:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f800/0xcd9d312a94a06ef0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.049333:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f800/0xcd9d312a94a06ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.049345:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f800/0xcd9d312a94a06ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938781.049513:0:30630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784938781.049518:0:30630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938781.049618:0:30630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f800/0xcd9d312a94a06ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.049648:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06ee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54f8 expref: 8 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.049665:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f800/0xcd9d312a94a06ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54f8 expref: 7 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.049674:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974705272d00) 00010000:00010000:2.0:1784938781.049677:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938781.049680:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924f800, rc 0) 00000100:00100000:2.0:1784938781.049746:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:21521:x1871643326037888:12345-192.168.202.4@tcp:101:bash.0 Request processed in 559us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.049797:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:3.0:1784938781.061978:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.062019:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326038016 00000100:00100000:3.0:1784938781.062030:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326038016 00000100:00100000:3.0:1784938781.062082:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:3.0:1784938781.062091:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:21521:x1871643326038016:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:3.0:1784938781.062111:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.062132:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01a00/0xcd9d312a94a06ef7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d54ff expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062199:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06efe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062223:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06efe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062235:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06efe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062264:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062273:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062280:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062635:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01800/0xcd9d312a94a06f0c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062644:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01800/0xcd9d312a94a06f0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062652:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01800/0xcd9d312a94a06f0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938781.062741:0:30631:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784938781.062746:0:30631:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938781.062863:0:30631:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01800/0xcd9d312a94a06f0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062876:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06efe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062892:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06efe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062898:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06efe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062904:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.062908:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06efe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062916:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06efe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062929:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974705272d00) 00010000:00010000:3.0:1784938781.062932:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.062938:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06efe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062944:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06efe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062958:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062964:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062970:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062975:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.062985:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062991:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.062999:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97470909ef00) 00010000:00010000:3.0:1784938781.063002:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.063005:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.063011:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.063047:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01a00/0xcd9d312a94a06ef7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54ff expref: 9 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.063061:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01800/0xcd9d312a94a06f0c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54ff expref: 8 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.063068:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97470909e100) 00010000:00010000:3.0:1784938781.063071:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938781.063073:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01800, rc 0) 00000100:00100000:3.0:1784938781.063127:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+8:21521:x1871643326038016:12345-192.168.202.4@tcp:101:bash.0 Request processed in 1036us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938781.063134:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:3.0:1784938781.080693:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.080732:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326038144 00000100:00100000:3.0:1784938781.080742:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326038144 00000100:00100000:3.0:1784938781.080818:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:3.0:1784938781.080843:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+8:21521:x1871643326038144:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:3.0:1784938781.080867:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.080890:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a06f13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5506 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.080966:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a06f1a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.080983:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a06f1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.080996:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a06f1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081068:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a06f21 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081077:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a06f21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081085:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a06f21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081555:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00a00/0xcd9d312a94a06f28 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081565:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00a00/0xcd9d312a94a06f28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081573:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00a00/0xcd9d312a94a06f28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938781.081672:0:30630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x3:0x0]: returning size 6656 00000004:00200000:3.0:1784938781.081676:0:30630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938781.081782:0:30630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00a00/0xcd9d312a94a06f28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081795:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a06f1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081802:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a06f1a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081809:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a06f1a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081815:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.081819:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a06f1a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081826:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a06f1a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081838:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97470909e100) 00010000:00010000:3.0:1784938781.081840:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.081845:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a06f1a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081851:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a06f1a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081862:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a06f21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081878:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a06f21 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081885:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a06f21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081890:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.081893:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a06f21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081899:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a06f21 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081907:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0xf20aa046 (ffff97470909e300) 00010000:00010000:3.0:1784938781.081909:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.081912:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a06f21 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081918:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a06f21 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0xf20aa046 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081949:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a06f13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5506 expref: 10 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081963:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00a00/0xcd9d312a94a06f28 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5506 expref: 9 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.081970:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff97470909e700) 00010000:00010000:3.0:1784938781.081973:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938781.081981:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e00a00, rc 0) 00000100:00100000:3.0:1784938781.082045:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+9:21521:x1871643326038144:12345-192.168.202.4@tcp:101:bash.0 Request processed in 1204us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938781.082053:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:2.0:1784938781.092813:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.092977:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326038400 00000100:00100000:3.0:1784938781.092989:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326038400 00000100:00100000:3.0:1784938781.093047:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:3.0:1784938781.093058:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+9:21521:x1871643326038400:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:3.0:1784938781.093080:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.093101:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01a00/0xcd9d312a94a06f2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d550d expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093182:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f36 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093197:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093209:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093224:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06f3d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093232:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06f3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093238:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06f3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093489:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093503:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f36 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093510:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f36 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093534:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.093539:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f36 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093546:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f36 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093562:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff97470909e700) 00010000:00010000:3.0:1784938781.093565:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.093570:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f36 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093575:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06f36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093585:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06f3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093591:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06f3d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093596:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06f3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093601:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.093610:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06f3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093615:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06f3d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093624:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0xaaab9583 (ffff97470909ef00) 00010000:00010000:3.0:1784938781.093626:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.093628:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06f3d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093633:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06f3d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093670:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01a00/0xcd9d312a94a06f2f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d550d expref: 10 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093679:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff97470909e700) 00010000:00010000:3.0:1784938781.093681:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938781.093684:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01a00/0xcd9d312a94a06f2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d550d expref: 10 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.093692:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01a00, rc 0) 00000100:00100000:3.0:1784938781.093790:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+9:21521:x1871643326038400:12345-192.168.202.4@tcp:101:bash.0 Request processed in 733us (988us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938781.093797:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000001:00080000:1.0:1784938781.116352:0:30612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1784938781.242627:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.243010:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326038528 00000100:00100000:2.0:1784938781.243024:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326038528 00000100:00100000:2.0:1784938781.243183:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:2.0:1784938781.243194:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+8:25036:x1871643326038528:12345-192.168.202.4@tcp:101:mkdir.0 00010000:00010000:2.0:1784938781.243216:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.243237:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5514 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.243309:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.243335:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.243348:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.243361:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.243368:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.243375:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244047:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924ea00/0xcd9d312a94a06f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244069:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924ea00/0xcd9d312a94a06f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244077:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924ea00/0xcd9d312a94a06f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938781.244324:0:30632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784938781.244329:0:30632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938781.244415:0:30632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97460924ea00/0xcd9d312a94a06f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244429:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244436:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244443:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244450:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.244454:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244463:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244476:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974705272d00) 00010000:00010000:2.0:1784938781.244479:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.244484:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244501:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244632:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244640:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244646:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244651:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924fc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.244654:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244661:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244669:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc82c34f8 (ffff974705272f00) 00010000:00010000:2.0:1784938781.244672:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.244675:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244681:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244866:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5514 expref: 10 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244893:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924ea00/0xcd9d312a94a06f59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5514 expref: 9 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.244902:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974705272900) 00010000:00010000:2.0:1784938781.244904:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938781.244907:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924ea00, rc 0) 00000100:00100000:2.0:1784938781.245041:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+9:25036:x1871643326038528:12345-192.168.202.4@tcp:101:mkdir.0 Request processed in 1846us (2421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.245051:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:0.0:1784938781.250030:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.250458:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326038784 00000100:00100000:2.0:1784938781.250469:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326038784 00000100:00100000:2.0:1784938781.250545:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:2.0:1784938781.250556:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+9:25036:x1871643326038784:12345-192.168.202.4@tcp:36:mkdir.0 00010000:00010000:2.0:1784938781.250956:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f60 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.250976:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.250988:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.251051:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.251059:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.251077:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938781.253392:0:30630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 512 00010000:00010000:2.0:1784938781.253408:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.253418:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f60 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.253426:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.253431:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924fc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.253436:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.253444:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f60 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.253461:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974705272900) 00010000:00010000:2.0:1784938781.253464:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.253469:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f60 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.253476:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938781.253489:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017121ba2 reply state 000000004dc2206d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.253510:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938781.254030:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+11:25036:x1871643326038784:12345-192.168.202.4@tcp:36:mkdir.0 Request processed in 3472us (4005us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784938781.254039:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00010000:00010000:2.0:1784938781.257535:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.257555:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.257565:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.257571:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.257577:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.257585:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.257603:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa1c75412 (ffff974705272f00) 00010000:00010000:2.0:1784938781.257607:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.257613:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.257620:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.280859:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.281420:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326038912 00000100:00100000:2.0:1784938781.281432:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326038912 00000100:00100000:2.0:1784938781.281539:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:2.0:1784938781.281549:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+10:25037:x1871643326038912:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.281576:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.281596:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d551b expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.281669:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.281683:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.281694:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.281709:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.281716:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.281722:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.281851:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06f83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.281860:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06f83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.281867:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06f83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938781.281917:0:30632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 512 00000004:00200000:2.0:1784938781.281921:0:30632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938781.281961:0:30632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06f83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.281973:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.281979:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.281986:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.281991:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924fc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.281995:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.282002:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.282013:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974705272900) 00010000:00010000:2.0:1784938781.282016:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.282021:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.282027:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.282040:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.282055:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.282062:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.282067:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924e000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.282070:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.282075:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.282083:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa1c75412 (ffff974705272f00) 00010000:00010000:2.0:1784938781.282086:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.282089:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.282094:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.282128:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d551b expref: 12 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.282142:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06f83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d551b expref: 11 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.282149:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.282152:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938781.282159:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924fe00, rc 0) 00000100:00100000:2.0:1784938781.282449:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+11:25037:x1871643326038912:12345-192.168.202.4@tcp:101:cp.0 Request processed in 900us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.282457:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:0.0:1784938781.288735:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.289143:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326039040 00000100:00100000:2.0:1784938781.289155:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326039040 00000100:00100000:2.0:1784938781.289238:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:2.0:1784938781.289286:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+11:25037:x1871643326039040:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.289310:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.289549:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5522 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.289640:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.289656:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.289668:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290567:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290582:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290592:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290668:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290687:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290694:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290700:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924e000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.290704:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290712:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290725:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.290728:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.290732:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290738:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290773:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290779:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290785:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290790:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924fc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.290797:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290805:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290813:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x45c0cf9c (ffff974705272f00) 00010000:00010000:2.0:1784938781.290815:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.290818:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290824:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a06f98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290867:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f8a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5522 expref: 12 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290877:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.290879:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.290882:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a06f8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5522 expref: 12 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.290891:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924f000, rc 0) 00000100:00100000:2.0:1784938781.291015:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+11:25037:x1871643326039040:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1768us (2289us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938781.291023:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:1.0:1784938781.295472:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.295555:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326039296 00000100:00100000:2.0:1784938781.295567:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326039296 00000100:00100000:2.0:1784938781.295637:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:2.0:1784938781.295648:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+11:25037:x1871643326039296:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.295691:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.295695:0:30632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784938781.295725:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a06f83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d551b expref: 11 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.295744:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.295800:0:30632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938781.295817:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5529 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.295966:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06fa6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.295981:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.295992:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.296004:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06fad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.296011:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.296016:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938781.296968:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1784938781.297134:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b800/0xcd9d312a94a06fb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.297154:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b800/0xcd9d312a94a06fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.297165:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b800/0xcd9d312a94a06fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.297747:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06fa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.297785:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06fa6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.297792:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06fa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.297798:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924fa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.297802:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06fa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.297811:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06fa6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.297823:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272e00) 00010000:00010000:2.0:1784938781.297827:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.297831:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06fa6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.297838:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a06fa6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938781.297853:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7270870 reply state 000000006acf9401 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.297871:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938781.297917:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a06f9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5529 expref: 13 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.297941:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b800/0xcd9d312a94a06fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5529 expref: 12 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.297948:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff974705272700) 00010000:00010000:2.0:1784938781.297950:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938781.297953:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148b800, rc 0) 00000100:00100000:2.0:1784938781.298095:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+13:25037:x1871643326039296:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2448us (2630us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784938781.298104:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:1.0:1784938781.307094:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.307292:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.307325:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.307354:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326039552 00000100:00100000:1.0:1784938781.307363:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326039552 00000100:00100000:1.0:1784938781.307421:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326039680 00000100:00100000:1.0:1784938781.307425:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326039680 00000100:00100000:1.0:1784938781.307444:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:1.0:1784938781.307453:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+5:10023:x1871643326039552:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938781.307527:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+5:10023:x1871643326039552:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 75us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.307534:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:1.0:1784938781.307552:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:1.0:1784938781.307558:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+5:10023:x1871643326039680:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938781.307583:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+5:10023:x1871643326039680:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 25us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.307589:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00080000:1.0:1784938781.307674:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938781.307679:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938781.313743:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326039424 00000100:00100000:2.0:1784938781.313779:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326039424 00010000:00010000:3.0:1784938781.314421:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.314453:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06fad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.314460:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06fad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.314466:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.314470:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06fad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.314479:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06fad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.314495:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x45c0cf9c (ffff974705272a00) 00010000:00010000:3.0:1784938781.314498:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.314503:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06fad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.314509:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a06fad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x45c0cf9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.314675:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 132 00000100:00100000:1.0:1784938781.314694:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+9:10026:x1871643326039424:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938781.314796:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+9:10026:x1871643326039424:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 104us (7712us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.318458:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 132 00000100:00100000:0.0:1784938781.318700:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.318788:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326039808 00000100:00100000:1.0:1784938781.318797:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326039808 00000100:00100000:1.0:1784938781.319005:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:1.0:1784938781.319016:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+5:10025:x1871643326039808:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938781.319034:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938781.319360:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a06fc2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5530 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938781.319391:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938781.319411:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=935s v=(0 0) 00010000:00010000:1.0:1784938781.319416:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.319426:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a06fc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5530 expref: 6 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.319447:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a06fc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5530 expref: 6 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.319461:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29c00, rc 0) 00000100:00100000:1.0:1784938781.319519:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:10025:x1871643326039808:12345-192.168.202.4@tcp:101:cp.0 Request processed in 504us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.319525:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:0.0:1784938781.327511:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.330587:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326039936 00000100:00100000:3.0:1784938781.330604:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326039936 00000100:00100000:3.0:1784938781.330679:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:3.0:1784938781.330690:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:25037:x1871643326039936:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.330709:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.330733:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000718078d0/0xcd9d312a94a06fc9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5537 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.330806:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a06fc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5530 expref: 7 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.330815:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938781.330819:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938781.330824:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000718078d0/0xcd9d312a94a06fc9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5537 expref: 7 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.330859:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a06fc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5530 expref: 7 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.330873:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a06fc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5530 expref: 7 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.330887:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f55f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342539648:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938781.330981:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.337984:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.338016:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f55f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342539648:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938781.338055:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000718078d0/0xcd9d312a94a06fc9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5537 expref: 7 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.338077:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01a00, rc 0) 00000100:00100000:0.0:1784938781.338087:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326040064 00000100:00100000:0.0:1784938781.338095:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326040064 00010000:00010000:0.0:1784938781.338139:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a06fc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5530 expref: 8 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.338140:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+8:25037:x1871643326039936:12345-192.168.202.4@tcp:101:cp.0 Request processed in 7453us (10638us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938781.338149:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:0.0:1784938781.338179:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:0.0:1784938781.338188:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:10025:x1871643326040064:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938781.338207:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938781.338229:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a06fc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5530 expref: 7 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.338242:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a06fc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5530 expref: 7 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.338277:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a06fc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5530 expref: 7 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.338299:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.338303:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.338311:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000718078d0/0xcd9d312a94a06fc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5537 expref: 6 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.338322:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000718078d0/0xcd9d312a94a06fc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5537 expref: 6 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.338354:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000718078d0/0xcd9d312a94a06fc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5537 expref: 6 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.338379:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342539776:192.168.202.4@tcp:105: 00000100:00100000:0.0:1784938781.338446:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938781.343336:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342539776:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938781.343363:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938781.343435:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:10025:x1871643326040064:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5247us (5459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.343446:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:1.0:1784938781.345640:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.345739:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326040320 00000100:00100000:3.0:1784938781.345783:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326040320 00000100:00100000:3.0:1784938781.345838:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:3.0:1784938781.345849:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+12:25037:x1871643326040320:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938781.346237:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+13:25037:x1871643326040320:12345-192.168.202.4@tcp:35:cp.0 Request processed in 389us (604us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1784938781.346245:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:1.0:1784938781.352829:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.352899:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326040448 00000100:00100000:2.0:1784938781.352909:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326040448 00000100:00100000:2.0:1784938781.352972:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:2.0:1784938781.352984:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+13:25037:x1871643326040448:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.353010:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.353032:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b400/0xcd9d312a94a06fd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d553e expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353113:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a06fd7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353145:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a06fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353160:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a06fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353174:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a06fde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353180:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a06fde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353186:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a06fde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353324:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b600/0xcd9d312a94a06fe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353332:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b600/0xcd9d312a94a06fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353339:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b600/0xcd9d312a94a06fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938781.353374:0:30630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 512 00000004:00200000:2.0:1784938781.353377:0:30630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938781.353417:0:30630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b600/0xcd9d312a94a06fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353431:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a06fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353448:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a06fd7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353454:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a06fd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353459:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148b200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.353464:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a06fd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353472:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a06fd7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353485:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974705272900) 00010000:00010000:2.0:1784938781.353488:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.353493:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a06fd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353499:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a06fd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353513:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a06fde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353519:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a06fde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353525:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a06fde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353529:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148ba00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.353538:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a06fde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353544:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a06fde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353552:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa1c75412 (ffff974705272e00) 00010000:00010000:2.0:1784938781.353554:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.353557:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a06fde lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353562:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a06fde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353593:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b400/0xcd9d312a94a06fd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d553e expref: 15 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353606:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b600/0xcd9d312a94a06fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d553e expref: 14 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.353624:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.353627:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938781.353629:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148b600, rc 0) 00000100:00100000:2.0:1784938781.353701:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:25037:x1871643326040448:12345-192.168.202.4@tcp:101:cp.0 Request processed in 719us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.353708:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:1.0:1784938781.365315:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.365517:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326040576 00000100:00100000:3.0:1784938781.365528:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326040576 00000100:00100000:3.0:1784938781.365595:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:3.0:1784938781.365605:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:25037:x1871643326040576:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.365636:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.365661:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06fec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5545 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.365742:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06ff3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.365811:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.365824:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.365840:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a06ffa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.365848:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a06ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.365875:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a06ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.365941:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.365948:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06ff3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.365954:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.365960:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.365964:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.365971:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06ff3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.365984:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.365987:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.365991:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06ff3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.365997:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a06ff3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.366009:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a06ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.366015:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a06ffa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.366027:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a06ffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.366033:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.366036:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a06ffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.366042:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a06ffa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.366050:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x56569231 (ffff97470909ef00) 00010000:00010000:3.0:1784938781.366052:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.366055:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a06ffa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.366061:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a06ffa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.366097:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06fec lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5545 expref: 15 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.366107:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.366110:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.366115:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a06fec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5545 expref: 15 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.366125:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01400, rc 0) 00000100:00100000:3.0:1784938781.366195:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:25037:x1871643326040576:12345-192.168.202.4@tcp:101:cp.0 Request processed in 590us (890us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938781.366212:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:1.0:1784938781.376025:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.377416:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326040704 00000100:00100000:2.0:1784938781.377430:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326040704 00000100:00100000:2.0:1784938781.377511:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:2.0:1784938781.377523:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:25037:x1871643326040704:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.377561:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.377584:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07001 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d554c expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377651:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07008 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377665:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07008 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377676:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07008 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377689:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148aa00/0xcd9d312a94a0700f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377706:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148aa00/0xcd9d312a94a0700f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377713:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148aa00/0xcd9d312a94a0700f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377814:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07008 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377821:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07008 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377827:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07008 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377833:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148b200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.377843:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07008 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377851:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07008 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377864:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.377866:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.377871:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07008 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377877:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07008 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377890:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148aa00/0xcd9d312a94a0700f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377897:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148aa00/0xcd9d312a94a0700f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377902:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148aa00/0xcd9d312a94a0700f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377906:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148aa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.377909:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148aa00/0xcd9d312a94a0700f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377915:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148aa00/0xcd9d312a94a0700f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377921:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x56569231 (ffff974705272e00) 00010000:00010000:2.0:1784938781.377923:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.377933:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148aa00/0xcd9d312a94a0700f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377939:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148aa00/0xcd9d312a94a0700f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377975:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07001 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d554c expref: 15 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.377985:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.377987:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.377990:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07001 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d554c expref: 15 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.378000:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148ba00, rc 0) 00000100:00100000:2.0:1784938781.378121:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:25037:x1871643326040704:12345-192.168.202.4@tcp:101:cp.0 Request processed in 600us (2104us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938781.378129:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:2.0:1784938781.390165:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.390290:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326040960 00000100:00100000:3.0:1784938781.390301:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326040960 00000100:00100000:3.0:1784938781.390370:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:3.0:1784938781.390380:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:25037:x1871643326040960:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.390402:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.390425:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07016 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5553 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.390567:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0701d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.390582:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0701d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.390594:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0701d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.390609:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a07024 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x56569231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.390617:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a07024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.390624:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a07024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938781.391175:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1784938781.391350:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a0702b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.391366:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a0702b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.391375:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a0702b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.391414:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0701d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.391421:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0701d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.391427:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0701d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.391433:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.391437:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0701d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.391444:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0701d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.391456:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.391459:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.391464:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0701d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.391470:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0701d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938781.391481:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007affc3d4 reply state 00000000f0576b90 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a07024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.391496:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938781.391526:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07016 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5553 expref: 17 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.391539:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a0702b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5553 expref: 16 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.391546:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97470909e200) 00010000:00010000:3.0:1784938781.391548:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938781.391550:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01200, rc 0) 00000100:00100000:3.0:1784938781.391627:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+17:25037:x1871643326040960:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1248us (1471us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784938781.391636:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 25 00010000:00010000:2.0:1784938781.397573:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a07024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.397593:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a07024 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.397600:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a07024 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.397606:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.397612:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a07024 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.397636:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a07024 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.397653:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x56569231 (ffff97470909ef00) 00010000:00010000:2.0:1784938781.397656:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.397662:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a07024 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.397668:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00400/0xcd9d312a94a07024 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x56569231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.398716:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.399202:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326041088 00000100:00100000:0.0:1784938781.399212:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326041088 00000100:00100000:0.0:1784938781.399337:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:0.0:1784938781.399350:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+5:10023:x1871643326041088:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938781.399375:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938781.399405:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a07039 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d555a expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938781.399438:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938781.399465:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=935s v=(0 0) 00010000:00010000:0.0:1784938781.399471:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.399484:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a07039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d555a expref: 6 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.399507:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a07039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d555a expref: 6 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.399541:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609397200, rc 0) 00000100:00100000:0.0:1784938781.399623:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:10023:x1871643326041088:12345-192.168.202.4@tcp:101:cp.0 Request processed in 275us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.399631:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:3.0:1784938781.412157:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.412260:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326041216 00000100:00100000:0.0:1784938781.412270:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326041216 00000100:00100000:0.0:1784938781.412337:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:0.0:1784938781.412347:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:25037:x1871643326041216:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938781.412367:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938781.412387:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a07040 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5561 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.412421:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a07039 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d555a expref: 7 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.412435:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.412440:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.412445:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a07040 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5561 expref: 7 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.412477:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a07039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d555a expref: 7 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.412491:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a07039 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d555a expref: 7 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.412517:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:31425:1871643342539904:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938781.412605:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.419114:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.419240:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:31425:1871643342539904:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938781.419292:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a07040 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5561 expref: 7 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.419313:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609397600, rc 0) 00000100:00100000:0.0:1784938781.419386:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:25037:x1871643326041216:12345-192.168.202.4@tcp:101:cp.0 Request processed in 7040us (7236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.419394:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:3.0:1784938781.419589:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326041344 00000100:00100000:3.0:1784938781.419596:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326041344 00010000:00010000:3.0:1784938781.419632:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a07039 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d555a expref: 7 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.419670:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:3.0:1784938781.419679:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:10024:x1871643326041344:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938781.419693:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938781.419716:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a07039 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d555a expref: 7 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.419748:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a07039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d555a expref: 7 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.419824:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a07039 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d555a expref: 7 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.419839:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938781.419844:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938781.419853:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a07040 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5561 expref: 6 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.419862:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a07040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5561 expref: 6 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.419938:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a07040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5561 expref: 6 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.419955:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735402d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342540032:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938781.420009:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.442916:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.443000:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326041600 00000100:00100000:3.0:1784938781.443010:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326041600 00000100:00100000:3.0:1784938781.443080:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:3.0:1784938781.443089:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+16:25037:x1871643326041600:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938781.443529:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+17:25037:x1871643326041600:12345-192.168.202.4@tcp:35:cp.0 Request processed in 440us (631us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784938781.443538:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:1.0:1784938781.444704:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735402d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342540032:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938781.444732:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938781.444808:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:10024:x1871643326041344:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 25130us (25705us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.444818:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:2.0:1784938781.461899:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.461992:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326041728 00000100:00100000:3.0:1784938781.462002:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326041728 00000100:00100000:3.0:1784938781.462072:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:3.0:1784938781.462082:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+17:25037:x1871643326041728:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.462121:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.462144:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07047 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5568 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462219:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0704e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462235:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0704e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462259:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0704e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462285:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07055 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462292:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462299:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462371:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0704e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462378:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0704e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462385:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0704e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462391:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.462401:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0704e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462410:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0704e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462423:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.462426:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.462431:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0704e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462437:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0704e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462450:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462457:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07055 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462462:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07055 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462467:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.462469:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07055 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462475:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07055 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462482:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa6e7eec (ffff97470909e800) 00010000:00010000:3.0:1784938781.462484:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.462492:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07055 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462498:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07055 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462533:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07047 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5568 expref: 18 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462542:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.462544:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.462547:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07047 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5568 expref: 18 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.462555:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01400, rc 0) 00000100:00100000:3.0:1784938781.462619:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+17:25037:x1871643326041728:12345-192.168.202.4@tcp:101:cp.0 Request processed in 538us (730us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938781.462626:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:2.0:1784938781.466156:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.466235:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326041856 00000100:00100000:3.0:1784938781.466247:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326041856 00000100:00100000:3.0:1784938781.466329:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:3.0:1784938781.466339:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+17:25037:x1871643326041856:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.466364:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.466388:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a0705c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d556f expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466463:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07063 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466494:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07063 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466506:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07063 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466521:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0706a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466528:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0706a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466535:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0706a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466602:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07063 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466609:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07063 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466615:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07063 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466620:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.466625:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07063 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466633:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07063 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466644:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.466653:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.466659:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07063 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466665:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07063 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466680:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0706a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466685:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0706a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466691:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0706a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466696:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.466699:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0706a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466705:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0706a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466712:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa6e7eec (ffff97470909e300) 00010000:00010000:3.0:1784938781.466714:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.466716:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0706a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466722:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0706a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466807:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a0705c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d556f expref: 18 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466829:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.466832:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.466836:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a0705c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d556f expref: 18 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.466846:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01c00, rc 0) 00000100:00100000:3.0:1784938781.466903:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+17:25037:x1871643326041856:12345-192.168.202.4@tcp:101:cp.0 Request processed in 565us (757us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938781.466911:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:2.0:1784938781.480980:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.481260:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326042112 00000100:00100000:0.0:1784938781.481283:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326042112 00000100:00100000:0.0:1784938781.481352:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:0.0:1784938781.481364:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+17:25037:x1871643326042112:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938781.481386:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938781.481408:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609396c00/0xcd9d312a94a07071 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5576 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.481540:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609396000/0xcd9d312a94a07078 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.481554:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609396000/0xcd9d312a94a07078 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.481564:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609396000/0xcd9d312a94a07078 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.481596:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a0707f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.481603:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a0707f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.481610:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a0707f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938781.482134:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1784938781.482316:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974609397200/0xcd9d312a94a07086 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.482326:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609397200/0xcd9d312a94a07086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.482335:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609397200/0xcd9d312a94a07086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.482368:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609396000/0xcd9d312a94a07078 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.482375:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609396000/0xcd9d312a94a07078 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.482381:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609396000/0xcd9d312a94a07078 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.482387:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938781.482391:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609396000/0xcd9d312a94a07078 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.482408:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609396000/0xcd9d312a94a07078 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.482421:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938781.482424:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.482429:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609396000/0xcd9d312a94a07078 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.482434:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609396000/0xcd9d312a94a07078 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938781.482449:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005857a3d2 reply state 00000000970c97f5 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a0707f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.482459:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938781.482495:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609396c00/0xcd9d312a94a07071 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5576 expref: 20 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.482509:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974609397200/0xcd9d312a94a07086 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5576 expref: 19 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.482517:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff974607c00600) 00010000:00010000:0.0:1784938781.482520:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938781.482522:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609397200, rc 0) 00000100:00100000:0.0:1784938781.482606:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+20:25037:x1871643326042112:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1244us (1636us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1784938781.482615:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:0.0:1784938781.491496:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1784938781.491812:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a0707f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.491825:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a0707f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.491833:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a0707f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.491839:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.491844:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a0707f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.491851:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a0707f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.491868:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa6e7eec (ffff974607c00200) 00010000:00010000:3.0:1784938781.491871:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.491876:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a0707f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.491893:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a0707f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xa6e7eec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.493736:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326042240 00000100:00100000:1.0:1784938781.493783:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326042240 00000100:00100000:1.0:1784938781.493850:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:1.0:1784938781.493861:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:10025:x1871643326042240:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938781.493881:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938781.493903:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f52e61e7/0xcd9d312a94a07094 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d557d expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938781.493933:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938781.493960:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=935s v=(0 0) 00010000:00010000:1.0:1784938781.493966:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.493975:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f52e61e7/0xcd9d312a94a07094 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d557d expref: 7 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.494012:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f52e61e7/0xcd9d312a94a07094 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d557d expref: 7 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.494026:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f28a00, rc 0) 00000100:00100000:1.0:1784938781.494098:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:10025:x1871643326042240:12345-192.168.202.4@tcp:101:cp.0 Request processed in 239us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.494106:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:1.0:1784938781.507960:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.508051:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326042368 00000100:00100000:0.0:1784938781.508074:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326042368 00000100:00100000:0.0:1784938781.508136:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:0.0:1784938781.508147:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:25037:x1871643326042368:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938781.508167:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938781.508189:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0709b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5584 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.508226:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f52e61e7/0xcd9d312a94a07094 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d557d expref: 8 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.508234:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.508239:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.508244:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0709b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->393215] (req 0->393215) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5584 expref: 8 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.508297:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f52e61e7/0xcd9d312a94a07094 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d557d expref: 8 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.508312:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f52e61e7/0xcd9d312a94a07094 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d557d expref: 8 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.508337:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342540160:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938781.508447:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.515897:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.516126:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326042496 00000100:00100000:1.0:1784938781.516136:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326042496 00000100:00100000:0.0:1784938781.516162:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342540160:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938781.516175:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f52e61e7/0xcd9d312a94a07094 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d557d expref: 9 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.516189:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0709b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->393215] (req 0->393215) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5584 expref: 9 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.516218:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00010000:00010000:0.0:1784938781.516225:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609396c00, rc 0) 00000100:00100000:1.0:1784938781.516226:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97470988f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+9:10026:x1871643326042496:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938781.516240:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938781.516271:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f52e61e7/0xcd9d312a94a07094 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d557d expref: 9 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.516293:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f52e61e7/0xcd9d312a94a07094 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d557d expref: 9 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.516317:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f52e61e7/0xcd9d312a94a07094 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d557d expref: 9 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.516344:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1784938781.516344:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+8:25037:x1871643326042368:12345-192.168.202.4@tcp:101:cp.0 Request processed in 8199us (8394us total) trans 0 rc 0/0 00010000:00010000:1.0:1784938781.516348:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1784938781.516351:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00010000:00010000:1.0:1784938781.516355:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0709b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5584 expref: 8 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.516365:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0709b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5584 expref: 7 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.516399:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0709b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5584 expref: 7 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.516414:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735400380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342540288:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938781.516466:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938781.525892:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735400380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342540288:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938781.525923:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938781.525988:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97470988f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:10026:x1871643326042496:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9762us (10101us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.526000:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:2.0:1784938781.530910:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.531695:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326042752 00000100:00100000:3.0:1784938781.531707:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326042752 00000100:00100000:3.0:1784938781.531861:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:3.0:1784938781.531873:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705cd8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+19:25037:x1871643326042752:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938781.532243:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705cd8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+20:25037:x1871643326042752:12345-192.168.202.4@tcp:35:cp.0 Request processed in 372us (1343us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1784938781.532262:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:2.0:1784938781.538554:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.538634:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326042880 00000100:00100000:3.0:1784938781.538645:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326042880 00000100:00100000:3.0:1784938781.538703:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:3.0:1784938781.538713:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+20:25037:x1871643326042880:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.538741:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.539174:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a070a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d558b expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539276:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a070a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539293:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a070a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539306:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a070a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539626:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a070b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539649:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a070b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539657:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a070b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539721:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a070a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539728:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a070a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539734:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a070a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539740:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.539744:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a070a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539913:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a070a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539927:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.539930:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.539935:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a070a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539941:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a070a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539953:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a070b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539967:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a070b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539973:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a070b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539978:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.539981:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a070b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539986:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a070b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.539994:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe6b34bd0 (ffff97470909e300) 00010000:00010000:3.0:1784938781.539996:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.539998:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a070b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.540004:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a070b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.540042:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a070a2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d558b expref: 21 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.540053:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.540055:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.540059:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a070a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d558b expref: 21 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.540080:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01c00, rc 0) 00000100:00100000:3.0:1784938781.540146:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+20:25037:x1871643326042880:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1433us (1601us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938781.540154:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:3.0:1784938781.543443:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.543734:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326043008 00000100:00100000:2.0:1784938781.543746:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326043008 00000100:00100000:2.0:1784938781.543839:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:2.0:1784938781.543850:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+20:25037:x1871643326043008:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.543871:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.543891:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b400/0xcd9d312a94a070b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5592 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544001:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a070be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544017:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a070be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544030:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a070be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544046:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a070c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544053:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a070c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544060:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a070c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544127:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a070be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544135:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a070be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544140:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a070be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544146:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.544150:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a070be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544166:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a070be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544178:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.544181:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.544185:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a070be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544191:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a070be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544203:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a070c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544209:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a070c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544215:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a070c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544220:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148ba00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.544223:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a070c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544229:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a070c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544235:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe6b34bd0 (ffff974705272e00) 00010000:00010000:2.0:1784938781.544238:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.544241:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a070c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544376:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a070c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544418:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b400/0xcd9d312a94a070b7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5592 expref: 21 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544428:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.544430:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.544433:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b400/0xcd9d312a94a070b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5592 expref: 21 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.544443:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148b400, rc 0) 00000100:00100000:2.0:1784938781.544513:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+20:25037:x1871643326043008:12345-192.168.202.4@tcp:101:cp.0 Request processed in 665us (1077us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938781.544522:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:2.0:1784938781.548642:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.548712:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326043264 00000100:00100000:3.0:1784938781.548722:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326043264 00000100:00100000:3.0:1784938781.548802:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:3.0:1784938781.548812:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+20:25037:x1871643326043264:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.548834:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.548857:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a070cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5599 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.548999:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a070d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.549013:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a070d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.549025:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a070d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.549041:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a070da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.549047:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a070da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.549074:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a070da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938781.549734:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1784938781.549925:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00200/0xcd9d312a94a070e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.549936:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00200/0xcd9d312a94a070e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.549944:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00200/0xcd9d312a94a070e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.549978:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a070d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.549985:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a070d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.549993:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a070d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.549999:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.550003:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a070d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.550011:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a070d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.550023:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.550026:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.550039:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a070d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.550046:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a070d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938781.550061:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000497d8894 reply state 000000007875efc4 transno 4294967305 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a070da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.550071:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938781.550106:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a070cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5599 expref: 23 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.550120:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00200/0xcd9d312a94a070e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5599 expref: 22 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.550127:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97470909e000) 00010000:00010000:3.0:1784938781.550130:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938781.550132:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e00200, rc 0) 00000100:00100000:3.0:1784938781.550200:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:25037:x1871643326043264:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1389us (1567us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1784938781.550208:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:2.0:1784938781.555549:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1784938781.555652:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a070da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.555665:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a070da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.555673:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a070da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.555678:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938781.555683:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a070da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.555691:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a070da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.555709:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe6b34bd0 (ffff97470909e800) 00010000:00010000:0.0:1784938781.555712:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.555717:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a070da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.555723:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a070da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe6b34bd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.557615:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326043392 00000100:00100000:3.0:1784938781.557631:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326043392 00000100:00100000:3.0:1784938781.557739:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:3.0:1784938781.557778:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+6:10023:x1871643326043392:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.557801:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.557821:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd63d40b/0xcd9d312a94a070ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55a0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938781.557866:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938781.557885:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=935s v=(0 0) 00010000:00010000:3.0:1784938781.557890:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938781.557900:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd63d40b/0xcd9d312a94a070ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a0 expref: 7 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.558121:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cd63d40b/0xcd9d312a94a070ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a0 expref: 7 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.558137:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01c00, rc 0) 00000100:00100000:3.0:1784938781.558210:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:10023:x1871643326043392:12345-192.168.202.4@tcp:101:cp.0 Request processed in 462us (2671us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938781.558218:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:1.0:1784938781.561871:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.562022:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326043520 00000100:00100000:0.0:1784938781.562049:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326043520 00000100:00100000:0.0:1784938781.562102:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:0.0:1784938781.562113:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:25037:x1871643326043520:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938781.562132:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938781.562151:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a070f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55a7 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.562183:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd63d40b/0xcd9d312a94a070ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a0 expref: 8 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.562192:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.562196:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.562202:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a070f6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a7 expref: 8 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.562233:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd63d40b/0xcd9d312a94a070ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a0 expref: 8 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.562256:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd63d40b/0xcd9d312a94a070ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a0 expref: 8 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.562270:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:31425:1871643342540416:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938781.562370:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938781.565472:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:31425:1871643342540416:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938781.565516:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a070f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a7 expref: 8 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.565564:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609396e00, rc 0) 00000100:00100000:0.0:1784938781.565636:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+8:25037:x1871643326043520:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3524us (3775us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.565646:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:2.0:1784938781.566998:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.567083:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326043648 00000100:00100000:1.0:1784938781.567093:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326043648 00010000:00010000:1.0:1784938781.567132:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd63d40b/0xcd9d312a94a070ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a0 expref: 8 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.567192:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:1.0:1784938781.567204:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+8:10024:x1871643326043648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938781.567221:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938781.567245:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd63d40b/0xcd9d312a94a070ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a0 expref: 8 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.567267:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd63d40b/0xcd9d312a94a070ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a0 expref: 8 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.567300:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd63d40b/0xcd9d312a94a070ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a0 expref: 8 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.567328:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.567334:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.567343:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a070f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a7 expref: 7 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.567354:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a070f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a7 expref: 7 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.567390:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a070f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a7 expref: 7 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.567405:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735403480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342540544:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938781.567485:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938781.571623:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735403480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342540544:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938781.571656:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938781.571725:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:10024:x1871643326043648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4523us (4733us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.571738:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:3.0:1784938781.575989:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.576087:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326043904 00000100:00100000:2.0:1784938781.576098:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326043904 00000100:00100000:2.0:1784938781.576164:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:2.0:1784938781.576175:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+22:25037:x1871643326043904:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:2.0:1784938781.576593:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:25037:x1871643326043904:12345-192.168.202.4@tcp:35:cp.0 Request processed in 418us (613us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1784938781.576601:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:2.0:1784938781.580899:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.581238:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326044032 00000100:00100000:3.0:1784938781.581258:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326044032 00000100:00100000:3.0:1784938781.581466:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:3.0:1784938781.581476:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:25037:x1871643326044032:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.581502:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.581522:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a070fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55ae expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581583:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07104 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581609:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581621:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581636:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0710b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581643:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0710b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581649:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0710b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581710:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581717:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07104 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581723:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07104 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581729:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.581734:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07104 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581741:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07104 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581797:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.581807:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.581813:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07104 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581820:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07104 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581835:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0710b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581840:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0710b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581846:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0710b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581851:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.581854:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0710b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581860:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0710b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581868:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9ca112ae (ffff97470909e900) 00010000:00010000:3.0:1784938781.581870:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.581873:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0710b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581878:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0710b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.581992:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a070fd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ae expref: 24 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.582008:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.582010:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.582014:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a070fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ae expref: 24 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.582023:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01400, rc 0) 00000100:00100000:3.0:1784938781.582084:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:25037:x1871643326044032:12345-192.168.202.4@tcp:101:cp.0 Request processed in 610us (1196us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938781.582092:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:1.0:1784938781.585019:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.585433:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326044160 00000100:00100000:2.0:1784938781.585443:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326044160 00000100:00100000:2.0:1784938781.585526:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:2.0:1784938781.585535:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:25037:x1871643326044160:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.585554:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.585573:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07112 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55b5 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585634:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07119 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585647:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585660:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585685:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07120 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585692:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585699:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585785:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585792:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07119 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585815:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585821:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.585825:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585833:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07119 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585844:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.585847:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.585852:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07119 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585859:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07119 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585872:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585878:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07120 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585884:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07120 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585889:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148bc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.585892:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07120 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585918:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07120 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585928:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9ca112ae (ffff974705272e00) 00010000:00010000:2.0:1784938781.585930:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.585933:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07120 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585939:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07120 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585973:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07112 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55b5 expref: 24 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585983:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.585985:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.585989:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07112 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55b5 expref: 24 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.585998:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148b200, rc 0) 00000100:00100000:2.0:1784938781.586060:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:25037:x1871643326044160:12345-192.168.202.4@tcp:101:cp.0 Request processed in 526us (1052us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938781.586067:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:0.0:1784938781.590950:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.591087:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326044416 00000100:00100000:3.0:1784938781.591099:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326044416 00000100:00100000:3.0:1784938781.591166:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:3.0:1784938781.591176:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:25037:x1871643326044416:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.591196:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.591217:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07127 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55bc expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.591417:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0712e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.591433:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0712e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.591444:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0712e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.591459:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07135 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.591473:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07135 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.591480:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07135 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938781.591977:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1784938781.592139:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0713c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.592149:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0713c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.592158:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0713c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.592190:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0712e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.592197:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0712e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.592204:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0712e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.592209:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.592213:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0712e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.592221:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0712e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.592244:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.592256:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.592262:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0712e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.592269:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0712e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938781.592282:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003eefbb7c reply state 0000000051eb4736 transno 4294967307 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07135 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.592290:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938781.592322:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07127 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55bc expref: 26 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.592336:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0713c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55bc expref: 25 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.592344:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97470909e800) 00010000:00010000:3.0:1784938781.592346:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938781.592347:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e00000, rc 0) 00000100:00100000:3.0:1784938781.592423:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:25037:x1871643326044416:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1248us (1481us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1784938781.592432:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00010000:00010000:3.0:1784938781.595232:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07135 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.595261:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07135 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.595296:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07135 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.595303:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.595308:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07135 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.595325:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07135 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.595344:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9ca112ae (ffff97470909e900) 00010000:00010000:3.0:1784938781.595348:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.595352:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07135 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.595360:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01e00/0xcd9d312a94a07135 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9ca112ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.598628:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.598851:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326044544 00000100:00100000:3.0:1784938781.598862:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326044544 00000100:00100000:3.0:1784938781.598926:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:3.0:1784938781.598935:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:10025:x1871643326044544:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.598952:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.598972:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092dedbf9/0xcd9d312a94a0714a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55c3 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938781.598997:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938781.599016:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=935s v=(0 0) 00010000:00010000:3.0:1784938781.599032:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938781.599042:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092dedbf9/0xcd9d312a94a0714a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55c3 expref: 8 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.599063:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092dedbf9/0xcd9d312a94a0714a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55c3 expref: 8 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.599076:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01400, rc 0) 00000100:00100000:3.0:1784938781.599136:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+8:10025:x1871643326044544:12345-192.168.202.4@tcp:101:cp.0 Request processed in 202us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938781.599143:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:0.0:1784938781.603146:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.603327:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326044672 00000100:00100000:3.0:1784938781.603338:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326044672 00000100:00100000:3.0:1784938781.603413:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:3.0:1784938781.603428:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+8:25037:x1871643326044672:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.603453:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.603474:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abdd541d/0xcd9d312a94a07151 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55ca expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.603513:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092dedbf9/0xcd9d312a94a0714a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55c3 expref: 9 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.603521:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938781.603527:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938781.603533:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abdd541d/0xcd9d312a94a07151 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ca expref: 9 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.603802:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092dedbf9/0xcd9d312a94a0714a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55c3 expref: 9 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.603817:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092dedbf9/0xcd9d312a94a0714a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55c3 expref: 9 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.603831:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f55d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342540672:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938781.603924:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.606531:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.606638:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326044800 00000100:00100000:1.0:1784938781.606647:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326044800 00010000:00010000:1.0:1784938781.606687:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092dedbf9/0xcd9d312a94a0714a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55c3 expref: 10 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.606801:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:1.0:1784938781.606811:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+10:10026:x1871643326044800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938781.606825:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938781.606851:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092dedbf9/0xcd9d312a94a0714a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55c3 expref: 10 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.606866:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092dedbf9/0xcd9d312a94a0714a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55c3 expref: 10 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.606891:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.606895:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.606903:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abdd541d/0xcd9d312a94a07151 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ca expref: 10 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.606914:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abdd541d/0xcd9d312a94a07151 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ca expref: 10 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.606952:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000abdd541d/0xcd9d312a94a07151 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ca expref: 10 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.606985:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735403800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342540800:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938781.607078:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca240 going to sleep for 11 seconds 00010000:00010000:3.0:1784938781.607567:0:31425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092dedbf9/0xcd9d312a94a0714a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55c3 expref: 10 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.607584:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f55d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342540672:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938781.607609:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000abdd541d/0xcd9d312a94a07151 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ca expref: 9 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.607620:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01e00, rc 0) 00000100:00100000:3.0:1784938781.607666:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+9:25037:x1871643326044672:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4245us (4532us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938781.607675:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:1.0:1784938781.609036:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735403800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342540800:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938781.609132:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938781.609181:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+8:10026:x1871643326044800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2371us (2660us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.609192:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:2.0:1784938781.611617:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.611737:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.611940:0:31431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326045056 00000100:00100000:1.0:1784938781.611950:0:31431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326045056 00000100:00100000:3.0:1784938781.611999:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326044928 00002000:00100000:1.0:1784938781.612001:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->391199) req@ffff9746047be300 x1871643326045056/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:257/0 lens 488/0 e 0 to 0 dl 1784938792 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784938781.612003:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326044928 00002000:00100000:1.0:1784938781.612012:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047be300 with x1871643326045056 ext(0->391199) 00002000:00010000:1.0:1784938781.612017:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9746047be300 00000100:00100000:1.0:1784938781.612130:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00002000:00100000:0.0:1784938781.612130:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (0->902) req@ffff974601f3d500 x1871643326044928/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:257/0 lens 1392/0 e 0 to 0 dl 1784938792 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938781.612138:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601f3d500 with x1871643326044928 ext(0->902) 00000100:00100000:1.0:1784938781.612140:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+9:10023:x1871643326045056:12345-192.168.202.4@tcp:4:cp.0 00002000:00010000:0.0:1784938781.612142:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974601f3d500 00000100:00100000:1.0:1784938781.620092:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+11:10023:x1871643326045056:12345-192.168.202.4@tcp:4:cp.0 Request processed in 7942us (8474us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1784938781.620109:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00002000:00100000:1.0:1784938781.620124:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->391199) req@ffff9746047be300 x1871643326045056/t4294967302(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:257/0 lens 488/448 e 0 to 0 dl 1784938792 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938781.620135:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047be300 with x1871643326045056 ext(0->391199) 00002000:00010000:1.0:1784938781.620142:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9746047be300 00000100:00100000:1.0:1784938781.620190:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:1.0:1784938781.620201:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+10:10023:x1871643326044928:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938781.620540:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+12:10023:x1871643326044928:12345-192.168.202.4@tcp:4:cp.0 Request processed in 341us (8802us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1784938781.620548:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00002000:00100000:1.0:1784938781.620555:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->902) req@ffff974601f3d500 x1871643326044928/t4294967303(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:257/0 lens 1392/448 e 0 to 0 dl 1784938792 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938781.620563:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601f3d500 with x1871643326044928 ext(0->902) 00002000:00010000:1.0:1784938781.620567:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974601f3d500 00000100:00100000:2.0:1784938781.623861:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.624090:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326045312 00000100:00100000:1.0:1784938781.624101:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326045312 00000100:00100000:1.0:1784938781.624202:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:1.0:1784938781.624213:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:25037:x1871643326045312:12345-192.168.202.4@tcp:35:cp.0 00000001:00080000:1.0:1784938781.624648:0:30633:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967308 00000100:00100000:1.0:1784938781.624956:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:25037:x1871643326045312:12345-192.168.202.4@tcp:35:cp.0 Request processed in 742us (1103us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1784938781.624965:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00000020:00080000:1.0:1784938781.624971:0:30633:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784938781.628513:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.628629:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326045440 00000100:00100000:3.0:1784938781.628640:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326045440 00000100:00100000:3.0:1784938781.628798:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:3.0:1784938781.628827:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:25037:x1871643326045440:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.628857:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.628880:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07158 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55d1 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.628961:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0715f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.628977:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0715f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.628989:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0715f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629005:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629012:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629019:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629088:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0715f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629095:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0715f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629102:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0715f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629119:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.629123:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0715f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629130:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0715f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629143:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.629146:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.629151:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0715f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629157:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0715f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629171:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629177:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07166 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629182:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629187:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.629190:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629195:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07166 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629214:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9fe9a331 (ffff97470909e900) 00010000:00010000:3.0:1784938781.629217:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.629221:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07166 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629227:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629281:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07158 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55d1 expref: 28 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629292:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.629294:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.629298:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07158 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55d1 expref: 28 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.629308:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01400, rc 0) 00000100:00100000:3.0:1784938781.629379:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:25037:x1871643326045440:12345-192.168.202.4@tcp:101:cp.0 Request processed in 554us (879us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938781.629388:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:0.0:1784938781.632403:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.632518:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326045568 00000100:00100000:2.0:1784938781.632548:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326045568 00000100:00100000:2.0:1784938781.632646:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:2.0:1784938781.632658:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:25037:x1871643326045568:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.632681:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.632705:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a0716d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55d8 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.632816:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07174 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.632831:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07174 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.632842:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07174 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.632857:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0717b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.632864:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0717b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.632870:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0717b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.632947:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07174 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.632956:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07174 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.632967:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07174 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.632981:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148bc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.632986:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07174 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.632994:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07174 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.633006:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.633009:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.633014:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07174 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.633021:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a07174 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.633039:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0717b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.633044:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0717b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.633050:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0717b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.633055:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148b200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.633058:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0717b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.633063:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0717b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.633082:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9fe9a331 (ffff974705272e00) 00010000:00010000:2.0:1784938781.633085:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.633088:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0717b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.633094:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0717b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.633131:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a0716d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55d8 expref: 28 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.633142:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.633144:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.633148:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a0716d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55d8 expref: 28 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.633163:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148a800, rc 0) 00000100:00100000:2.0:1784938781.633221:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:25037:x1871643326045568:12345-192.168.202.4@tcp:101:cp.0 Request processed in 564us (828us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938781.633228:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:2.0:1784938781.636642:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.637054:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326045824 00000100:00100000:3.0:1784938781.637065:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326045824 00000100:00100000:3.0:1784938781.637123:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:3.0:1784938781.637133:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:25037:x1871643326045824:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.637155:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.637176:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07182 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55df expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.637526:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07189 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.637542:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07189 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.637554:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07189 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.637567:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07190 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.637575:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07190 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.637581:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07190 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938781.638630:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1784938781.639046:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974609396400/0xcd9d312a94a07197 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.639061:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609396400/0xcd9d312a94a07197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.639085:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609396400/0xcd9d312a94a07197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.639130:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07189 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.639138:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07189 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.639144:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07189 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.639151:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938781.639155:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07189 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.639162:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07189 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.639176:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938781.639178:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.639183:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07189 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.639189:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01c00/0xcd9d312a94a07189 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938781.639202:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000658ca2df reply state 00000000da11dc02 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07190 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.639211:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938781.639264:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07182 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55df expref: 30 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.639414:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974609396400/0xcd9d312a94a07197 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55df expref: 29 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.639422:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff974607c00700) 00010000:00010000:0.0:1784938781.639424:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938781.639427:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609396400, rc 0) 00000100:00100000:0.0:1784938781.639568:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:25037:x1871643326045824:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2435us (2935us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784938781.639577:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:1.0:1784938781.646284:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.646596:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326045952 00000100:00100000:2.0:1784938781.646606:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326045952 00000100:00100000:2.0:1784938781.646665:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:2.0:1784938781.646676:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+7:10026:x1871643326045952:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.646698:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.646724:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a071a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55e6 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938781.646795:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938781.646818:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=935s v=(0 0) 00010000:00010000:2.0:1784938781.646822:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938781.646832:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a071a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55e6 expref: 8 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.646851:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a071a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55e6 expref: 8 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.646864:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148a800, rc 0) 00000100:00100000:2.0:1784938781.646917:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+8:10026:x1871643326045952:12345-192.168.202.4@tcp:101:cp.0 Request processed in 243us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.646924:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00010000:00010000:0.0:1784938781.648582:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07190 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.648598:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07190 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.648604:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07190 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.648611:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938781.648616:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07190 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.648625:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07190 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.648643:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9fe9a331 (ffff97470909e900) 00010000:00010000:0.0:1784938781.648645:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.648668:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07190 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.648674:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07190 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9fe9a331 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.651357:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.651438:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326046080 00000100:00100000:0.0:1784938781.651449:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326046080 00000100:00100000:0.0:1784938781.651514:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:0.0:1784938781.651524:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+8:25037:x1871643326046080:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938781.651543:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938781.651563:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a071ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55ed expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.651595:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a071a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55e6 expref: 9 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.651603:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.651608:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.651614:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a071ac lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ed expref: 9 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.651649:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a071a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55e6 expref: 9 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.651664:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a071a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55e6 expref: 9 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.651698:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601f3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:31425:1871643342540928:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938781.651819:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a54e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938781.656106:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.656783:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601f3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:31425:1871643342540928:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938781.656817:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a071ac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ed expref: 9 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.656837:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609396a00, rc 0) 00000100:00100000:0.0:1784938781.656902:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+9:25037:x1871643326046080:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5378us (5555us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.656920:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:1.0:1784938781.657170:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326046208 00000100:00100000:1.0:1784938781.657178:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326046208 00010000:00010000:1.0:1784938781.657212:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a071a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55e6 expref: 9 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.657238:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:1.0:1784938781.657257:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+9:10026:x1871643326046208:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938781.657283:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938781.657309:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a071a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55e6 expref: 9 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.657331:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a071a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55e6 expref: 9 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.657352:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000676eb84a/0xcd9d312a94a071a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55e6 expref: 9 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.657367:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.657371:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.657380:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a071ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ed expref: 8 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.657389:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a071ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ed expref: 8 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.657424:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a071ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ed expref: 8 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.657437:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735403b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342541056:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938781.657490:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0caa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938781.661451:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735403b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342541056:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938781.661479:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938781.661532:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+8:10026:x1871643326046208:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4286us (5437us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.661544:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:3.0:1784938781.665961:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.666014:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.666108:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326046464 00000100:00100000:2.0:1784938781.666119:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326046464 00002000:00100000:2.0:1784938781.666171:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->1734) req@ffff97473f55c380 x1871643326046464/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:257/0 lens 2224/0 e 0 to 0 dl 1784938792 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938781.666182:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55c380 with x1871643326046464 ext(0->1734) 00002000:00010000:2.0:1784938781.666188:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55c380 00000100:00100000:2.0:1784938781.666233:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326046336 00000100:00100000:2.0:1784938781.666237:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326046336 00002000:00100000:2.0:1784938781.666262:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->5633) req@ffff97473f55ed80 x1871643326046336/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:257/0 lens 6128/0 e 0 to 0 dl 1784938792 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938781.666278:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55ed80 with x1871643326046336 ext(0->5633) 00002000:00010000:2.0:1784938781.666296:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55ed80 00000100:00100000:2.0:1784938781.666329:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:2.0:1784938781.666339:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+9:10024:x1871643326046464:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938781.667133:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+11:10024:x1871643326046464:12345-192.168.202.4@tcp:4:cp.0 Request processed in 787us (1173us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1784938781.667142:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00002000:00100000:2.0:1784938781.667153:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->1734) req@ffff97473f55c380 x1871643326046464/t4294967302(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:257/0 lens 2224/448 e 0 to 0 dl 1784938792 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938781.667161:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55c380 with x1871643326046464 ext(0->1734) 00002000:00010000:2.0:1784938781.667164:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55c380 00000100:00100000:2.0:1784938781.667183:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:2.0:1784938781.667191:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+10:10024:x1871643326046336:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938781.667456:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+12:10024:x1871643326046336:12345-192.168.202.4@tcp:4:cp.0 Request processed in 265us (1441us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784938781.667462:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 3 00002000:00100000:2.0:1784938781.667468:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2:0x0] (0->5633) req@ffff97473f55ed80 x1871643326046336/t4294967303(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:257/0 lens 6128/448 e 0 to 0 dl 1784938792 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938781.667474:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55ed80 with x1871643326046336 ext(0->5633) 00002000:00010000:2.0:1784938781.667478:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55ed80 00000100:00100000:3.0:1784938781.677897:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.678007:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326046720 00000100:00100000:2.0:1784938781.678021:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326046720 00000100:00100000:2.0:1784938781.678094:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:2.0:1784938781.678105:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:25037:x1871643326046720:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:2.0:1784938781.678515:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:25037:x1871643326046720:12345-192.168.202.4@tcp:35:cp.0 Request processed in 411us (627us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784938781.678541:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:3.0:1784938781.690544:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.691616:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326046848 00000100:00100000:2.0:1784938781.691629:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326046848 00000100:00100000:2.0:1784938781.691790:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:2.0:1784938781.691802:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:25037:x1871643326046848:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.691829:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.691852:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a071b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55f4 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.691946:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a071ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.691961:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a071ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.691973:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a071ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692018:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a071c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692026:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a071c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692033:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a071c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692099:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a071ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692126:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a071ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692132:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a071ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692138:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148bc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.692142:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a071ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692150:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a071ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692174:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.692178:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.692183:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a071ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692188:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a071ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692204:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a071c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692220:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a071c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692226:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a071c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692231:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.692241:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a071c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692278:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a071c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692287:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x151c8ac3 (ffff974705272100) 00010000:00010000:2.0:1784938781.692290:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.692293:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a071c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692299:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a071c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692339:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a071b3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55f4 expref: 31 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692348:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.692350:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.692354:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a071b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55f4 expref: 31 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.692363:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148b200, rc 0) 00000100:00100000:2.0:1784938781.692443:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:25037:x1871643326046848:12345-192.168.202.4@tcp:101:cp.0 Request processed in 643us (1909us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938781.692451:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:3.0:1784938781.699514:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.703918:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326046976 00000100:00100000:0.0:1784938781.703935:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326046976 00000100:00100000:0.0:1784938781.704023:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:0.0:1784938781.704034:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:25037:x1871643326046976:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938781.704057:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938781.704081:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609396000/0xcd9d312a94a071c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d55fb expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.704153:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a071cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.705594:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a071cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.705710:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a071cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.705741:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a071d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706198:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a071d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706290:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a071d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706437:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a071cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706445:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a071cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706453:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a071cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706460:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938781.706466:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a071cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706474:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a071cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706488:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938781.706503:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.706510:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a071cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706516:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a071cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706534:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a071d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706540:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a071d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706546:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a071d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706551:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700031c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938781.706554:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a071d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706559:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a071d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706566:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x151c8ac3 (ffff974607c00100) 00010000:00010000:0.0:1784938781.706568:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.706571:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a071d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.706576:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a071d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.707120:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974609396000/0xcd9d312a94a071c8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55fb expref: 31 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.707141:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938781.707143:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.707148:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609396000/0xcd9d312a94a071c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55fb expref: 31 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.707159:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609396000, rc 0) 00000100:00100000:0.0:1784938781.709703:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:25037:x1871643326046976:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5657us (10186us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938781.709718:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:3.0:1784938781.713675:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.713808:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326047232 00000100:00100000:0.0:1784938781.713820:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326047232 00000100:00100000:0.0:1784938781.713886:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:0.0:1784938781.713897:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:25037:x1871643326047232:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938781.713927:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938781.713949:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031200/0xcd9d312a94a071dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5602 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.714092:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a071e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.714106:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a071e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.714118:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a071e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.714133:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a071eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.714156:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a071eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.714163:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a071eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938781.716517:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1784938781.716730:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29600/0xcd9d312a94a071f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.717179:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29600/0xcd9d312a94a071f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.717197:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29600/0xcd9d312a94a071f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.717373:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a071e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.717382:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a071e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.717389:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a071e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.717396:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938781.717401:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a071e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.717409:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a071e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.717423:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938781.717427:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.717431:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a071e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.717438:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a071e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938781.717455:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093342369 reply state 0000000078eaee89 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a071eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.717472:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938781.717516:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031200/0xcd9d312a94a071dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5602 expref: 33 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.717533:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29600/0xcd9d312a94a071f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5602 expref: 32 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.717541:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97473635ea00) 00010000:00010000:1.0:1784938781.717544:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938781.717546:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29600, rc 0) 00000100:00100000:1.0:1784938781.717716:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:25037:x1871643326047232:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3820us (4053us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1784938781.717726:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 40 00010000:00010000:3.0:1784938781.722945:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a071eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.722966:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a071eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.722987:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a071eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.722994:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700031e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.723000:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a071eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.723008:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a071eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.723027:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x151c8ac3 (ffff974607c00500) 00010000:00010000:3.0:1784938781.723029:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.723034:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a071eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.723040:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a071eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x151c8ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.724928:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.725027:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326047360 00000100:00100000:1.0:1784938781.725039:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326047360 00000100:00100000:1.0:1784938781.725104:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:1.0:1784938781.725113:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+12:10025:x1871643326047360:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938781.725133:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938781.725155:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a07200 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5609 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938781.725185:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938781.725205:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=935s v=(0 0) 00010000:00010000:1.0:1784938781.725221:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.725231:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a07200 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5609 expref: 13 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.725278:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a07200 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5609 expref: 13 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.725292:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29a00, rc 0) 00000100:00100000:1.0:1784938781.725362:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+13:10025:x1871643326047360:12345-192.168.202.4@tcp:101:cp.0 Request processed in 249us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.725369:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:0.0:1784938781.737542:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.737691:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326047488 00000100:00100000:3.0:1784938781.737703:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326047488 00000100:00100000:3.0:1784938781.737795:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:3.0:1784938781.737806:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+13:25037:x1871643326047488:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.737827:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.737846:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a07207 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5610 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.738102:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a07200 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5609 expref: 14 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.738132:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938781.738137:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938781.738142:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a07207 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5610 expref: 14 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.738177:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a07200 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5609 expref: 14 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.738191:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a07200 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5609 expref: 14 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.738215:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342541184:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938781.738412:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.741487:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342541184:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938781.741532:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a07207 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5610 expref: 14 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.741555:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e00400, rc 0) 00000100:00100000:2.0:1784938781.741630:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:25037:x1871643326047488:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3826us (4096us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.741640:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:3.0:1784938781.742822:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.742959:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326047616 00000100:00100000:1.0:1784938781.742968:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326047616 00010000:00010000:1.0:1784938781.743019:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a07200 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5609 expref: 14 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.743065:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:1.0:1784938781.743074:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:10025:x1871643326047616:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938781.743090:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938781.743120:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a07200 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5609 expref: 14 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.743135:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a07200 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5609 expref: 14 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.743160:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066d91362/0xcd9d312a94a07200 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5609 expref: 14 pid: 31427 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.743196:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.743200:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.743221:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a07207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5610 expref: 13 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.743232:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a07207 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5610 expref: 13 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.743287:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a07207 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5610 expref: 13 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.743302:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735401c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342541312:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938781.743553:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0caf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938781.747697:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735401c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342541312:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938781.747728:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938781.747822:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+13:10025:x1871643326047616:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4748us (5005us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.747833:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:3.0:1784938781.753266:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.753540:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326047872 00000100:00100000:2.0:1784938781.753549:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326047872 00000100:00100000:2.0:1784938781.753609:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:2.0:1784938781.753626:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:25037:x1871643326047872:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:2.0:1784938781.754020:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:25037:x1871643326047872:12345-192.168.202.4@tcp:35:cp.0 Request processed in 394us (770us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1784938781.754028:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:3.0:1784938781.757823:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.758142:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326048000 00000100:00100000:1.0:1784938781.758154:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326048000 00000100:00100000:1.0:1784938781.758222:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:1.0:1784938781.758232:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:25037:x1871643326048000:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938781.758269:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938781.758301:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a0720e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5617 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758397:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07215 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758413:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07215 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758424:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07215 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758439:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0721c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758446:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0721c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758453:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0721c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758525:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07215 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758534:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07215 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758541:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758548:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938781.758552:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758571:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07215 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758585:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938781.758588:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.758594:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07215 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758600:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07215 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758616:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0721c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758621:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0721c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758627:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0721c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758632:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938781.758635:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0721c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758642:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0721c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758648:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x15c8a56e (ffff97473635eb00) 00010000:00010000:1.0:1784938781.758651:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.758654:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0721c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758671:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0721c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758709:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a0720e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5617 expref: 34 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758720:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938781.758722:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.758726:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a0720e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5617 expref: 34 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.758736:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29a00, rc 0) 00000100:00100000:1.0:1784938781.758850:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:25037:x1871643326048000:12345-192.168.202.4@tcp:101:cp.0 Request processed in 618us (1042us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938781.758858:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:0.0:1784938781.771090:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.771293:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326048128 00000100:00100000:1.0:1784938781.771306:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326048128 00000100:00100000:1.0:1784938781.771422:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:1.0:1784938781.771433:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:25037:x1871643326048128:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938781.771458:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938781.771481:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07223 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d561e expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771549:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0722a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771563:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0722a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771586:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0722a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771600:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771607:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771614:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771682:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0722a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771689:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0722a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771696:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0722a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771702:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938781.771706:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0722a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771712:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0722a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771724:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938781.771727:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.771732:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0722a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771745:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a0722a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771851:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771858:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07231 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771864:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771869:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938781.771871:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771877:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07231 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771886:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x15c8a56e (ffff97473635eb00) 00010000:00010000:1.0:1784938781.771888:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.771891:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07231 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771896:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28e00/0xcd9d312a94a07231 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771931:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07223 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d561e expref: 34 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771952:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938781.771954:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.771958:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07223 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d561e expref: 34 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.771967:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29a00, rc 0) 00000100:00100000:1.0:1784938781.772085:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:25037:x1871643326048128:12345-192.168.202.4@tcp:101:cp.0 Request processed in 653us (1008us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938781.772092:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:3.0:1784938781.776689:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.776798:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326048384 00000100:00100000:2.0:1784938781.776810:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326048384 00000100:00100000:2.0:1784938781.776868:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:2.0:1784938781.776878:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:25037:x1871643326048384:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.776900:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.776933:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a07238 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5625 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.777068:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a0723f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.777084:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a0723f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.777096:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a0723f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.777111:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07246 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.777118:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.777125:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938781.777704:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1784938781.777891:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b400/0xcd9d312a94a0724d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.777902:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b400/0xcd9d312a94a0724d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.777910:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b400/0xcd9d312a94a0724d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.777945:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a0723f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.777952:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a0723f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.777959:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a0723f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.777965:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148bc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.777970:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a0723f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.777978:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a0723f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.778460:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.778465:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.778470:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a0723f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.778492:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148bc00/0xcd9d312a94a0723f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938781.778511:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079676730 reply state 000000007312cf79 transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.778522:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938781.778561:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a200/0xcd9d312a94a07238 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5625 expref: 36 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.778578:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b400/0xcd9d312a94a0724d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5625 expref: 35 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.778585:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff974705272a00) 00010000:00010000:2.0:1784938781.778587:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938781.778590:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148b400, rc 0) 00000100:00100000:2.0:1784938781.778676:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:25037:x1871643326048384:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1798us (1997us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1784938781.778686:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 43 00010000:00010000:1.0:1784938781.783651:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.783669:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07246 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.783676:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.783681:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148ba00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938781.783686:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.783693:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07246 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.783712:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x15c8a56e (ffff974705272100) 00010000:00010000:1.0:1784938781.783716:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.783721:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07246 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.783745:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07246 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x15c8a56e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.785732:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.786436:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326048512 00000100:00100000:2.0:1784938781.786448:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326048512 00000100:00100000:2.0:1784938781.786549:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:2.0:1784938781.786560:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+12:10024:x1871643326048512:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.786580:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.786606:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bac2f56/0xcd9d312a94a0725b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d562c expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938781.786655:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938781.786677:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=935s v=(0 0) 00010000:00010000:2.0:1784938781.786682:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938781.786692:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bac2f56/0xcd9d312a94a0725b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d562c expref: 13 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.786709:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007bac2f56/0xcd9d312a94a0725b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d562c expref: 13 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.786723:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148aa00, rc 0) 00000100:00100000:2.0:1784938781.786828:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+13:10024:x1871643326048512:12345-192.168.202.4@tcp:101:cp.0 Request processed in 269us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.786836:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:0.0:1784938781.789978:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.790807:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326048640 00000100:00100000:1.0:1784938781.790818:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326048640 00000100:00100000:0.0:1784938781.790918:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:0.0:1784938781.790928:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+13:25037:x1871643326048640:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938781.790948:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938781.790969:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006946fef3/0xcd9d312a94a07262 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5633 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.790998:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007bac2f56/0xcd9d312a94a0725b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d562c expref: 14 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.791007:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.791011:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.791015:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006946fef3/0xcd9d312a94a07262 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5633 expref: 14 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.791051:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007bac2f56/0xcd9d312a94a0725b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d562c expref: 14 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.791084:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007bac2f56/0xcd9d312a94a0725b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d562c expref: 14 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.791098:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342541440:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938781.791281:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a546c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938781.797002:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.800889:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326048768 00000100:00100000:2.0:1784938781.800916:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326048768 00010000:00010000:2.0:1784938781.800975:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007bac2f56/0xcd9d312a94a0725b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d562c expref: 15 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.801021:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:2.0:1784938781.801030:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+15:10024:x1871643326048768:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938781.801048:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938781.801073:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007bac2f56/0xcd9d312a94a0725b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d562c expref: 15 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.801114:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007bac2f56/0xcd9d312a94a0725b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d562c expref: 15 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.801142:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938781.801146:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938781.801156:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006946fef3/0xcd9d312a94a07262 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5633 expref: 15 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.801166:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006946fef3/0xcd9d312a94a07262 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5633 expref: 15 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.801221:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006946fef3/0xcd9d312a94a07262 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5633 expref: 15 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.801236:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342541568:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938781.801360:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1dd80 going to sleep for 11 seconds 00010000:00010000:0.0:1784938781.801991:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bac2f56/0xcd9d312a94a0725b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d562c expref: 15 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.802010:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342541440:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938781.802041:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006946fef3/0xcd9d312a94a07262 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5633 expref: 14 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.802051:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031800, rc 0) 00000100:00100000:0.0:1784938781.802089:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:25037:x1871643326048640:12345-192.168.202.4@tcp:101:cp.0 Request processed in 11162us (12119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.802097:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:0.0:1784938781.809034:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.809176:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326049024 00000100:00100000:3.0:1784938781.809186:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326049024 00000100:00100000:3.0:1784938781.809359:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:3.0:1784938781.809370:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+35:25037:x1871643326049024:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938781.809791:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:25037:x1871643326049024:12345-192.168.202.4@tcp:35:cp.0 Request processed in 421us (764us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1784938781.809800:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:2.0:1784938781.810915:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342541568:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938781.810942:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938781.810994:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+13:10024:x1871643326048768:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9964us (14004us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.811004:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 23 10000000:01000000:0.0:1784938781.815050:0:30627:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784938781.815058:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff974724c7c800 from 4 10000000:01000000:0.0:1784938781.815063:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938781.815112:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974700031600/0xcd9d312a94a07269 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.815124:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974700031600/0xcd9d312a94a07269 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.815152:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974700031600/0xcd9d312a94a07269 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.815179:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342541696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938781.815183:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.815237:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938781.815286:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938781.815359:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326049152 00000100:00100000:3.0:1784938781.815369:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326049152 00000100:00100000:3.0:1784938781.815566:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:3.0:1784938781.815577:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:25037:x1871643326049152:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.815599:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.815615:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a07270 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d563a expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815683:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07277 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815697:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07277 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815707:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07277 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815719:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0727e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815737:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0727e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815743:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0727e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815840:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07277 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815849:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07277 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815855:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07277 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815862:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.815866:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07277 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815874:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07277 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815886:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.815889:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.815894:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07277 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815901:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07277 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815913:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0727e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815927:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0727e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815933:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0727e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815937:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.815941:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0727e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815948:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0727e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815956:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe7eb4718 (ffff97470909ea00) 00010000:00010000:3.0:1784938781.815959:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.815962:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0727e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.815967:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0727e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.816005:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a07270 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d563a expref: 37 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.816016:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.816019:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.816022:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a07270 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d563a expref: 37 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.816059:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e00600, rc 0) 00000100:00100000:3.0:1784938781.816128:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:25037:x1871643326049152:12345-192.168.202.4@tcp:101:cp.0 Request processed in 552us (950us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938781.816136:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:2.0:1784938781.816418:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342541696 00000100:00100000:2.0:1784938781.816425:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342541696 00000100:00100000:2.0:1784938781.816467:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784938781.816482:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342541696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938781.816493:0:30624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.816506:0:30624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97470148a200/0xcd9d312a94a07285 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a07269 expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.816524:0:30624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97470148a200/0xcd9d312a94a07285 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a07269 expref: 17 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.816534:0:30624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97470148a200/0xcd9d312a94a07285 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a07269 expref: 17 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.816541:0:30624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148a200, rc 0) 00000100:00100000:2.0:1784938781.817220:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342541696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 736us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.817229:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784938781.817372:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342541696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938781.817391:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974700031600/0xcd9d312a94a07269 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a07285 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.817401:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974700031600/0xcd9d312a94a07269 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a07285 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.817475:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342541824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938781.817509:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938781.817651:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.817691:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342541824 00000100:00100000:2.0:1784938781.817696:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342541824 00000100:00100000:2.0:1784938781.817832:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784938781.817956:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342541824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938781.819413:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342541824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1449us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.819425:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784938781.819505:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342541824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938781.819544:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342541952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938781.819582:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938781.819611:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.819653:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342541952 00000100:00100000:2.0:1784938781.819657:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342541952 00000100:00100000:2.0:1784938781.819694:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784938781.819699:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342541952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938781.820134:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342541952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 432us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.820158:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784938781.820353:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342541952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938781.820662:0:33054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33054:1871643342542080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938781.820703:0:33054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938781.820790:0:33054:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938781.821103:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342542080 00000100:00100000:0.0:1784938781.821110:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342542080 00000100:00100000:0.0:1784938781.821257:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784938781.821277:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:33054:x1871643342542080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938781.821516:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:33054:x1871643342542080:12345-0@lo:502:llog_process_th.0 Request processed in 250us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.821524:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784938781.821698:0:33054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33054:1871643342542080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938781.821732:0:33054:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938781.821742:0:33054:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938781.821746:0:33054:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784938781.821775:0:33054:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff974724c7c800 00000020:00000080:1.0:1784938781.821778:0:33054:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784938781.822324:0:33054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735402680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33054:1871643342542208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938781.822372:0:33054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938781.822458:0:33054:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938781.822811:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342542208 00000100:00100000:3.0:1784938781.822817:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342542208 00000100:00100000:3.0:1784938781.822855:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784938781.822864:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:33054:x1871643342542208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938781.823402:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:33054:x1871643342542208:12345-0@lo:502:llog_process_th.0 Request processed in 537us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938781.823411:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784938781.823829:0:33054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735402680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33054:1871643342542208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938781.823925:0:33054:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938781.823934:0:33054:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938781.823937:0:33054:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784938781.823945:0:33054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784938781.825132:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1784938781.825157:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938781.825167:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974700031600/0xcd9d312a94a07269 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a07285 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.825179:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974700031600/0xcd9d312a94a07269 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a07285 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938781.825190:0:30627:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938781.825192:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff974603c37000 from 4 10000000:01000000:3.0:1784938781.825195:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938781.825228:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e01c00/0xcd9d312a94a0728c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.825236:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974741e01c00/0xcd9d312a94a0728c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.825387:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974741e01c00/0xcd9d312a94a0728c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.825414:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342542336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938781.825478:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938781.825521:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974735af9540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.830639:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342542336 00000100:00100000:2.0:1784938781.830655:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342542336 00000100:00100000:2.0:1784938781.830979:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784938781.830992:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342542336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938781.831010:0:30624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.831029:0:30624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97470148bc00/0xcd9d312a94a07293 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a0728c expref: -99 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.831057:0:30624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97470148bc00/0xcd9d312a94a07293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a0728c expref: 18 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.831069:0:30624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97470148bc00/0xcd9d312a94a07293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a0728c expref: 18 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.831078:0:30624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148bc00, rc 0) 00000100:00100000:2.0:1784938781.831231:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342542336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (5752us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.831239:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784938781.831311:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342542336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938781.831329:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974741e01c00/0xcd9d312a94a0728c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a07293 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.831338:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974741e01c00/0xcd9d312a94a0728c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a07293 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.831431:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342542464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938781.831467:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938781.831496:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.831510:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342542464 00000100:00100000:2.0:1784938781.831513:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342542464 00000100:00100000:2.0:1784938781.831533:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784938781.831539:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342542464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938781.835505:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342542464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3956us (4027us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.835520:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784938781.835598:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342542464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938781.835658:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342542592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938781.835705:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938781.835736:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.835766:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342542592 00000100:00100000:2.0:1784938781.835772:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342542592 00000100:00100000:2.0:1784938781.835804:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784938781.835812:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342542592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938781.836009:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342542592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.836016:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784938781.836056:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342542592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938781.836575:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.836613:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326049280 00000100:00100000:0.0:1784938781.836619:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326049280 00000100:00100000:0.0:1784938781.836665:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:0.0:1784938781.836673:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:25037:x1871643326049280:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938781.836687:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938781.836707:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a0729a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5641 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836788:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a072a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836803:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a072a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836814:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a072a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836828:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a072a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836835:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a072a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836841:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a072a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836927:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a072a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836935:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a072a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836942:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a072a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836949:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700031a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938781.836954:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a072a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836962:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a072a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836974:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938781.836978:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.836982:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a072a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836988:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a072a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.836999:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a072a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.837004:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a072a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.837010:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a072a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.837021:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938781.837024:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a072a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.837030:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a072a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.837037:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe7eb4718 (ffff974607c00500) 00010000:00010000:0.0:1784938781.837040:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.837043:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a072a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.837048:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a072a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.837080:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a0729a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5641 expref: 37 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.837089:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938781.837092:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.837095:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a0729a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5641 expref: 37 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.837103:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031400, rc 0) 00000100:00100000:0.0:1784938781.837321:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:25037:x1871643326049280:12345-192.168.202.4@tcp:101:cp.0 Request processed in 647us (747us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938781.837329:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:1.0:1784938781.838003:0:33057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735402680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33057:1871643342542720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938781.838056:0:33057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938781.838096:0:33057:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0caf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.838635:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342542720 00000100:00100000:2.0:1784938781.838656:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342542720 00000100:00100000:2.0:1784938781.838711:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784938781.838720:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:33057:x1871643342542720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938781.838973:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:33057:x1871643342542720:12345-0@lo:502:llog_process_th.0 Request processed in 253us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.838981:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784938781.839040:0:33057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735402680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33057:1871643342542720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938781.839069:0:33057:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938781.839080:0:33057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938781.839083:0:33057:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784938781.839091:0:33057:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff974603c37000 00000020:00000080:2.0:1784938781.839094:0:33057:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784938781.839326:0:33057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33057:1871643342542848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938781.839365:0:33057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938781.839390:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342542848 00000100:00100000:2.0:1784938781.839394:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342542848 00000100:00100000:2.0:1784938781.839418:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784938781.839425:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:33057:x1871643342542848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938781.839538:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:33057:x1871643342542848:12345-0@lo:502:llog_process_th.0 Request processed in 113us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.839544:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784938781.839576:0:33057:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.839588:0:33057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33057:1871643342542848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938781.839607:0:33057:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938781.839611:0:33057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938781.839613:0:33057:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784938781.839616:0:33057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784938781.839687:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784938781.839708:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938781.839717:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e01c00/0xcd9d312a94a0728c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a07293 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.839728:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974741e01c00/0xcd9d312a94a0728c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a07293 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938781.839739:0:30627:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784938781.839742:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9747294ad000 from 4 10000000:01000000:2.0:1784938781.839744:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784938781.840392:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.840404:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.840414:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.840434:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342542976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938781.840475:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938781.840504:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938781.841049:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342542976 00000100:00100000:1.0:1784938781.841057:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342542976 00000100:00100000:1.0:1784938781.841105:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784938781.841124:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342542976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938781.841257:0:30625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938781.841274:0:30625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974735f28e00/0xcd9d312a94a072b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a072af expref: -99 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.841298:0:30625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974735f28e00/0xcd9d312a94a072b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a072af expref: 19 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.841308:0:30625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974735f28e00/0xcd9d312a94a072b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a072af expref: 19 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.841317:0:30625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f28e00, rc 0) 00000100:00100000:1.0:1784938781.841372:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342542976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.841378:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784938781.841457:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342542976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938781.841480:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.841489:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.841552:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342543104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938781.841583:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938781.841608:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a54300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938781.843055:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.843088:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326049536 00000100:00100000:3.0:1784938781.843094:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326049536 00000100:00100000:3.0:1784938781.843221:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:3.0:1784938781.843231:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:25037:x1871643326049536:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.843258:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.843288:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a072bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5648 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.843424:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a072c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.843438:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a072c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.843448:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a072c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.843462:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a072cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.843469:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a072cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.843483:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a072cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938781.844001:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00000100:00100000:1.0:1784938781.844282:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342543104 00000100:00100000:1.0:1784938781.844290:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342543104 00000100:00100000:1.0:1784938781.844332:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784938781.844340:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342543104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938781.844552:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342543104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (2967us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.844560:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784938781.844616:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342543104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938781.844670:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735402680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342543232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938781.844715:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938781.844744:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938781.844775:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342543232 00000100:00100000:1.0:1784938781.844785:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342543232 00000100:00100000:1.0:1784938781.844812:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784938781.844818:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460382b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342543232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938781.844962:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460382b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342543232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.844968:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784938781.845008:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735402680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342543232:0@lo:503:ll_cfg_requeue.0 00010000:00010000:3.0:1784938781.849178:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742173000/0xcd9d312a94a072d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.849200:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742173000/0xcd9d312a94a072d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.849211:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742173000/0xcd9d312a94a072d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.849261:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a072c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.849270:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a072c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.849277:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a072c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.849283:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.849288:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a072c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.849295:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a072c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.849307:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.849310:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.849329:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a072c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.849335:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a072c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938781.849351:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000644571a5 reply state 000000007fd72bcf transno 4294967316 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a072cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.849361:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938781.849404:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a072bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5648 expref: 39 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.849420:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742173000/0xcd9d312a94a072d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5648 expref: 38 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.849428:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97470909e500) 00010000:00010000:3.0:1784938781.849430:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938781.849433:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742173000, rc 0) 00000100:00100000:3.0:1784938781.849521:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+39:25037:x1871643326049536:12345-192.168.202.4@tcp:101:cp.0 Request processed in 6291us (6472us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1784938781.849530:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:2.0:1784938781.851059:0:33058:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33058:1871643342543360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938781.851128:0:33058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938781.851165:0:33058:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938781.851587:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342543360 00000100:00100000:0.0:1784938781.851594:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342543360 00000100:00100000:0.0:1784938781.851651:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784938781.851660:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:33058:x1871643342543360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938781.851920:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:33058:x1871643342543360:12345-0@lo:502:llog_process_th.0 Request processed in 259us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.851928:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784938781.852184:0:33058:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33058:1871643342543360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938781.852215:0:33058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938781.852224:0:33058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938781.852235:0:33058:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784938781.852254:0:33058:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9747294ad000 00000020:00000080:2.0:1784938781.852257:0:33058:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784938781.852336:0:33058:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33058:1871643342543488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938781.852373:0:33058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938781.852438:0:33058:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938781.855112:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342543488 00000100:00100000:0.0:1784938781.855129:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342543488 00000100:00100000:0.0:1784938781.855224:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784938781.855236:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:33058:x1871643342543488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938781.855528:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:33058:x1871643342543488:12345-0@lo:502:llog_process_th.0 Request processed in 295us (3153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.855535:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784938781.855640:0:33058:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33058:1871643342543488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938781.855682:0:33058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938781.855692:0:33058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938781.855694:0:33058:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784938781.855703:0:33058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784938781.858194:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1784938781.858230:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938781.858242:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.858263:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.860200:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1784938781.860508:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a072cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.860521:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a072cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.860529:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a072cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.860534:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.860539:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a072cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.860547:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a072cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.860565:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe7eb4718 (ffff97470909ea00) 00010000:00010000:3.0:1784938781.860569:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.860574:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a072cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.860580:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a072cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe7eb4718 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.860693:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326049664 00000100:00100000:2.0:1784938781.860703:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326049664 00000100:00100000:2.0:1784938781.860899:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:2.0:1784938781.860911:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+13:10026:x1871643326049664:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.860930:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.860953:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032105b5d/0xcd9d312a94a072e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d564f expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938781.860979:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938781.860997:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=935s v=(0 0) 00010000:00010000:2.0:1784938781.861001:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938781.861010:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032105b5d/0xcd9d312a94a072e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d564f expref: 14 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.861027:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032105b5d/0xcd9d312a94a072e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d564f expref: 14 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.861038:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148b200, rc 0) 00000100:00100000:2.0:1784938781.861104:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:10026:x1871643326049664:12345-192.168.202.4@tcp:101:cp.0 Request processed in 196us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938781.861111:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:2.0:1784938781.869544:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.871767:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326049792 00000100:00100000:3.0:1784938781.871781:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326049792 00000100:00100000:3.0:1784938781.871849:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:3.0:1784938781.871871:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:25037:x1871643326049792:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.871893:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.871924:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000573ac59a/0xcd9d312a94a072e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5656 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.871960:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032105b5d/0xcd9d312a94a072e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d564f expref: 15 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.871969:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938781.871974:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938781.871979:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000573ac59a/0xcd9d312a94a072e7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5656 expref: 15 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.872016:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032105b5d/0xcd9d312a94a072e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d564f expref: 15 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.872032:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032105b5d/0xcd9d312a94a072e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d564f expref: 15 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.872047:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342543616:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938781.872146:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff974735af9000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938781.876594:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.876697:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326049920 00000100:00100000:1.0:1784938781.876707:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326049920 00010000:00010000:1.0:1784938781.876778:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032105b5d/0xcd9d312a94a072e0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d564f expref: 16 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.876817:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:1.0:1784938781.876827:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+16:10026:x1871643326049920:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938781.876842:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784938781.876964:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342543616:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938781.876993:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000573ac59a/0xcd9d312a94a072e7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5656 expref: 16 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.877012:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172400, rc 0) 00000100:00100000:3.0:1784938781.877070:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+16:25037:x1871643326049792:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5210us (7537us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938781.877092:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 27 00010000:00010000:1.0:1784938781.877470:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032105b5d/0xcd9d312a94a072e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d564f expref: 15 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.877485:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032105b5d/0xcd9d312a94a072e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d564f expref: 15 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.877523:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032105b5d/0xcd9d312a94a072e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d564f expref: 15 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.877535:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.877540:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.877549:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000573ac59a/0xcd9d312a94a072e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5656 expref: 14 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.877560:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000573ac59a/0xcd9d312a94a072e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5656 expref: 14 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.877599:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000573ac59a/0xcd9d312a94a072e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5656 expref: 14 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.877614:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735403b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342543744:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938781.877679:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938781.881459:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735403b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342543744:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938781.881486:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938781.881548:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:10026:x1871643326049920:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4721us (4961us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.881559:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:3.0:1784938781.889109:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.889196:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326050176 00000100:00100000:2.0:1784938781.889217:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326050176 00000100:00100000:2.0:1784938781.889284:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:2.0:1784938781.889294:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705cd9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+38:25037:x1871643326050176:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:2.0:1784938781.889670:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705cd9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+39:25037:x1871643326050176:12345-192.168.202.4@tcp:35:cp.0 Request processed in 376us (573us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1784938781.889678:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:3.0:1784938781.893003:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.893170:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326050304 00000100:00100000:1.0:1784938781.893180:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326050304 00000100:00100000:1.0:1784938781.893281:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:1.0:1784938781.893306:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+39:25037:x1871643326050304:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938781.893332:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938781.893354:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a072ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d565d expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893425:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a072f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893441:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a072f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893453:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a072f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893511:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a072fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893518:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a072fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893524:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a072fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893591:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a072f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893599:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a072f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893605:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a072f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893624:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938781.893629:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a072f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893637:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a072f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893649:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938781.893652:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.893658:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a072f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893663:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a072f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893674:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a072fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893680:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a072fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893687:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a072fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893692:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938781.893694:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a072fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893700:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a072fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893719:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x48840fb6 (ffff97473635eb00) 00010000:00010000:1.0:1784938781.893722:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.893725:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a072fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893731:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a072fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893797:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a072ee lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d565d expref: 40 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893807:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938781.893810:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.893813:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a072ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d565d expref: 40 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.893822:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f28600, rc 0) 00000100:00100000:1.0:1784938781.893896:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+39:25037:x1871643326050304:12345-192.168.202.4@tcp:101:cp.0 Request processed in 592us (899us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938781.893904:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:0.0:1784938781.900404:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938781.900536:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326050432 00000100:00100000:2.0:1784938781.900548:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326050432 00000100:00100000:2.0:1784938781.900611:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:2.0:1784938781.900621:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+39:25037:x1871643326050432:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938781.900643:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938781.900669:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07303 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5664 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900735:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0730a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900790:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0730a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900802:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0730a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900817:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900824:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900845:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900919:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0730a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900926:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0730a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900933:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0730a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900939:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148b200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.900944:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0730a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900952:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0730a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900964:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.900968:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.900972:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0730a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900978:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0730a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900990:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.900995:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07311 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.901008:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.901014:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148ba00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.901017:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.901023:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07311 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.901032:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x48840fb6 (ffff974710f9b500) 00010000:00010000:2.0:1784938781.901034:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.901037:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07311 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.901043:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a07311 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.901077:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07303 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5664 expref: 40 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.901087:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938781.901089:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.901093:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07303 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5664 expref: 40 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.901103:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148a800, rc 0) 00000100:00100000:2.0:1784938781.901161:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+39:25037:x1871643326050432:12345-192.168.202.4@tcp:101:cp.0 Request processed in 541us (767us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938781.901179:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:2.0:1784938781.910061:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.910160:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326050688 00000100:00100000:3.0:1784938781.910171:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326050688 00000100:00100000:3.0:1784938781.910238:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:3.0:1784938781.910256:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+39:25037:x1871643326050688:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.910279:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.910304:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a07318 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d566b expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.910445:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742173600/0xcd9d312a94a0731f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.910459:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742173600/0xcd9d312a94a0731f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.910469:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742173600/0xcd9d312a94a0731f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.910482:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07326 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.910487:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07326 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.910493:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07326 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938781.911001:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1784938781.911177:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742173e00/0xcd9d312a94a0732d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.911186:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742173e00/0xcd9d312a94a0732d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.911194:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742173e00/0xcd9d312a94a0732d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.911230:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742173600/0xcd9d312a94a0731f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.911238:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742173600/0xcd9d312a94a0731f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.911256:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742173600/0xcd9d312a94a0731f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.911262:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742173600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938781.911267:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742173600/0xcd9d312a94a0731f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.911276:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742173600/0xcd9d312a94a0731f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.911288:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938781.911291:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938781.911295:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742173600/0xcd9d312a94a0731f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.911302:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742173600/0xcd9d312a94a0731f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938781.911328:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096fb77d2 reply state 000000003ab84c04 transno 4294967318 ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07326 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938781.911338:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938781.911371:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a07318 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d566b expref: 42 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.911387:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742173e00/0xcd9d312a94a0732d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d566b expref: 41 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.911395:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff97470909ed00) 00010000:00010000:3.0:1784938781.911397:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938781.911400:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742173e00, rc 0) 00000100:00100000:3.0:1784938781.911464:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+42:25037:x1871643326050688:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1218us (1411us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1784938781.911472:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 49 00010000:00010000:1.0:1784938781.913617:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07326 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.913633:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07326 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.913640:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07326 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.913662:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938781.913668:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07326 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.913675:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07326 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.913690:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x48840fb6 (ffff97470909ea00) 00010000:00010000:1.0:1784938781.913694:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.913699:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07326 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.913705:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07326 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x48840fb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.917677:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.917788:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326050816 00000100:00100000:0.0:1784938781.917801:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326050816 00000100:00100000:1.0:1784938781.917934:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:1.0:1784938781.917945:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+13:10024:x1871643326050816:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938781.917963:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938781.917987:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a0733b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5672 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938781.918016:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938781.918037:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=935s v=(0 0) 00010000:00010000:1.0:1784938781.918042:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938781.918052:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a0733b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5672 expref: 14 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.918082:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a0733b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5672 expref: 14 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.918096:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f28600, rc 0) 00000100:00100000:1.0:1784938781.918158:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:10024:x1871643326050816:12345-192.168.202.4@tcp:101:cp.0 Request processed in 215us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938781.918165:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:3.0:1784938781.920919:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.921429:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326050944 00000100:00100000:0.0:1784938781.921440:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326050944 00000100:00100000:0.0:1784938781.921502:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:0.0:1784938781.921512:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:25037:x1871643326050944:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938781.921530:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938781.921548:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058776656/0xcd9d312a94a07342 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5679 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.921578:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a0733b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5672 expref: 15 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.921587:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.921593:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.921598:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058776656/0xcd9d312a94a07342 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5679 expref: 15 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.921633:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a0733b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5672 expref: 15 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.921648:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a0733b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5672 expref: 15 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.921709:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342543872:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938781.921819:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a54300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938781.924560:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.924579:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342543872:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938781.924612:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058776656/0xcd9d312a94a07342 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5679 expref: 15 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.924632:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031200, rc 0) 00000100:00100000:3.0:1784938781.924730:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+15:25037:x1871643326050944:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3219us (3818us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938781.924739:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:2.0:1784938781.924739:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326051072 00000100:00100000:2.0:1784938781.924746:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326051072 00010000:00010000:2.0:1784938781.924801:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a0733b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5672 expref: 15 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.924847:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:2.0:1784938781.924864:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974709007050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+15:10023:x1871643326051072:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938781.924878:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938781.924902:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a0733b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5672 expref: 15 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.924915:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a0733b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5672 expref: 15 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.924937:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cf50166/0xcd9d312a94a0733b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5672 expref: 15 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.924951:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938781.924956:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938781.924963:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058776656/0xcd9d312a94a07342 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5679 expref: 14 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.924997:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058776656/0xcd9d312a94a07342 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5679 expref: 14 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.925030:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000058776656/0xcd9d312a94a07342 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5679 expref: 14 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.925042:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342544000:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938781.925095:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a8229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.928508:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.928741:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342544000:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938781.928823:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938781.928885:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326051328 00000100:00100000:1.0:1784938781.928893:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326051328 00000100:00100000:1.0:1784938781.928943:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:1.0:1784938781.928952:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+41:25037:x1871643326051328:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938781.929173:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974709007050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:10023:x1871643326051072:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4317us (4621us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.929182:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:1.0:1784938781.929281:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+42:25037:x1871643326051328:12345-192.168.202.4@tcp:35:cp.0 Request processed in 329us (782us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1784938781.929287:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:0.0:1784938781.934209:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.934283:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326051456 00000100:00100000:1.0:1784938781.934295:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326051456 00000100:00100000:1.0:1784938781.934360:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:1.0:1784938781.934369:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+42:25037:x1871643326051456:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938781.934394:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938781.934416:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a07349 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5680 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934485:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07350 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934516:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07350 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934527:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07350 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934543:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07357 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934550:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934556:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934624:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07350 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934632:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07350 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934638:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07350 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934644:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938781.934649:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07350 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934656:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07350 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934667:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938781.934676:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.934682:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07350 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934688:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07350 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934702:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934708:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07357 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934713:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07357 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934718:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938781.934720:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07357 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934725:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07357 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934733:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x48e4a31f (ffff97473635e000) 00010000:00010000:1.0:1784938781.934735:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.934738:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07357 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934743:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07357 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934840:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a07349 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5680 expref: 43 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934858:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938781.934861:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.934865:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a07349 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5680 expref: 43 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.934875:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29e00, rc 0) 00000100:00100000:1.0:1784938781.935665:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+42:25037:x1871643326051456:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1293us (1466us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938781.935675:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:2.0:1784938781.943111:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.943545:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326051584 00000100:00100000:0.0:1784938781.943556:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326051584 00000100:00100000:0.0:1784938781.943616:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:0.0:1784938781.943625:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+42:25037:x1871643326051584:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938781.943646:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938781.943670:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031000/0xcd9d312a94a0735e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5687 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943737:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07365 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943778:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07365 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943790:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07365 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943805:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a0736c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943813:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a0736c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943820:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a0736c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943902:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07365 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943910:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07365 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943917:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07365 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943923:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938781.943926:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07365 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943934:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07365 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943946:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938781.943949:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.943954:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07365 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943960:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07365 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943974:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a0736c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943980:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a0736c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943986:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a0736c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.943998:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700031e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938781.944002:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a0736c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.944008:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a0736c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.944017:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x48e4a31f (ffff974607c00500) 00010000:00010000:0.0:1784938781.944019:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.944021:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a0736c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.944026:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a0736c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.944055:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031000/0xcd9d312a94a0735e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5687 expref: 43 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.944064:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938781.944066:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938781.944069:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031000/0xcd9d312a94a0735e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5687 expref: 43 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.944078:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031000, rc 0) 00000100:00100000:0.0:1784938781.944141:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+42:25037:x1871643326051584:12345-192.168.202.4@tcp:101:cp.0 Request processed in 516us (1040us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938781.944158:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:2.0:1784938781.952439:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938781.953105:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326051840 00000100:00100000:1.0:1784938781.953117:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326051840 00000100:00100000:1.0:1784938781.953292:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:1.0:1784938781.953303:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+42:25037:x1871643326051840:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938781.953325:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938781.953348:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a07373 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d568e expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.953658:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a0737a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.953673:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a0737a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.953684:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a0737a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.953697:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07381 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.953717:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07381 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.953724:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07381 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938781.954666:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7:0x0], index 0: 0 00010000:00010000:1.0:1784938781.956413:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29400/0xcd9d312a94a07388 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.956506:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29400/0xcd9d312a94a07388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.956516:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29400/0xcd9d312a94a07388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.956549:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a0737a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.956554:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a0737a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.956558:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a0737a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.956562:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938781.956565:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a0737a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.956569:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a0737a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.956590:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938781.956592:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938781.956595:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a0737a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.956599:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a0737a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938781.956608:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c3991b5 reply state 000000000b28f6c0 transno 4294967320 ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07381 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938781.956614:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938781.956644:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a07373 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d568e expref: 45 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.956654:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29400/0xcd9d312a94a07388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d568e expref: 44 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938781.956658:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97473635e400) 00010000:00010000:1.0:1784938781.956660:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938781.956662:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29400, rc 0) 00000100:00100000:1.0:1784938781.956724:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+45:25037:x1871643326051840:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3423us (4291us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1784938781.956732:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 52 00010000:00010000:2.0:1784938781.958946:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07381 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.958962:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07381 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.958970:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07381 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.958976:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938781.958982:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07381 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.958990:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07381 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.959028:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x48e4a31f (ffff97473635e000) 00010000:00010000:2.0:1784938781.959032:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938781.959037:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07381 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938781.959043:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a07381 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x48e4a31f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938781.964727:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938781.965190:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326051968 00000100:00100000:3.0:1784938781.965214:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326051968 00000100:00100000:3.0:1784938781.965277:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:3.0:1784938781.965288:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:10026:x1871643326051968:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938781.965316:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938781.965339:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6087e00/0xcd9d312a94a07396 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5695 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938781.965367:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938781.965387:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=935s v=(0 0) 00010000:00010000:3.0:1784938781.965391:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938781.965401:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6087e00/0xcd9d312a94a07396 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5695 expref: 15 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.965419:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e6087e00/0xcd9d312a94a07396 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5695 expref: 15 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938781.965432:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172a00, rc 0) 00000100:00100000:3.0:1784938781.965493:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+15:10026:x1871643326051968:12345-192.168.202.4@tcp:101:cp.0 Request processed in 207us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938781.965501:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:3.0:1784938781.970239:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.970894:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326052096 00000100:00100000:0.0:1784938781.970920:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326052096 00000100:00100000:0.0:1784938781.971152:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:0.0:1784938781.971164:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+15:25037:x1871643326052096:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938781.971183:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938781.971202:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000446f1ddd/0xcd9d312a94a0739d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d569c expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.971234:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6087e00/0xcd9d312a94a07396 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5695 expref: 16 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.971253:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.971258:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.971263:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000446f1ddd/0xcd9d312a94a0739d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d569c expref: 16 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.971317:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6087e00/0xcd9d312a94a07396 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5695 expref: 16 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.971333:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6087e00/0xcd9d312a94a07396 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5695 expref: 16 pid: 31425 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.971348:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704027800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342544128:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938781.971478:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938781.976044:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704027800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342544128:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938781.976099:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000446f1ddd/0xcd9d312a94a0739d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d569c expref: 16 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.976143:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031000, rc 0) 00000100:00100000:0.0:1784938781.976215:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+16:25037:x1871643326052096:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5053us (5988us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.976224:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:2.0:1784938781.976925:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.977040:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326052224 00000100:00100000:0.0:1784938781.977109:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326052224 00010000:00010000:0.0:1784938781.977149:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6087e00/0xcd9d312a94a07396 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5695 expref: 16 pid: 31425 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.977198:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:0.0:1784938781.977208:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+16:10026:x1871643326052224:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938781.977223:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938781.977256:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6087e00/0xcd9d312a94a07396 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5695 expref: 16 pid: 31425 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.977426:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6087e00/0xcd9d312a94a07396 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5695 expref: 16 pid: 31425 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.977452:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6087e00/0xcd9d312a94a07396 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5695 expref: 16 pid: 31425 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.977471:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.977475:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938781.977484:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000446f1ddd/0xcd9d312a94a0739d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d569c expref: 15 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.977506:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000446f1ddd/0xcd9d312a94a0739d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d569c expref: 15 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938781.977541:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000446f1ddd/0xcd9d312a94a0739d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d569c expref: 15 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938781.977554:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704027800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342544256:192.168.202.4@tcp:105: 00000100:00100000:0.0:1784938781.977615:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938781.992914:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938781.993054:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704027800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342544256:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938781.993081:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938781.993141:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+15:10026:x1871643326052224:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 15934us (16217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938781.993153:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:1.0:1784938781.996806:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326052480 00000100:00100000:1.0:1784938781.996821:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326052480 00000100:00100000:1.0:1784938781.996898:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:1.0:1784938781.996909:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+44:25037:x1871643326052480:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:1.0:1784938781.997321:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+45:25037:x1871643326052480:12345-192.168.202.4@tcp:35:cp.0 Request processed in 412us (4415us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1784938781.997329:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:0.0:1784938782.000858:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.001167:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326052608 00000100:00100000:2.0:1784938782.001177:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326052608 00000100:00100000:2.0:1784938782.001264:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:2.0:1784938782.001284:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+45:25037:x1871643326052608:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938782.001469:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938782.001496:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a073a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56a3 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001563:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a073ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001577:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a073ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001588:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a073ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001603:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a073b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001625:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a073b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001632:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a073b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001699:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a073ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001708:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a073ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001715:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a073ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001722:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148b200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.001727:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a073ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001736:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a073ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001748:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.001835:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.001840:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a073ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001846:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a073ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001861:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a073b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001874:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a073b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001881:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a073b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001886:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.001890:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a073b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001898:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a073b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001907:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xbf79d746 (ffff974710f9b500) 00010000:00010000:2.0:1784938782.001909:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.001912:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a073b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001919:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a073b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001956:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a073a4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56a3 expref: 46 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001967:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.001969:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.001973:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a073a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56a3 expref: 46 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.001993:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148ba00, rc 0) 00000100:00100000:2.0:1784938782.002110:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+45:25037:x1871643326052608:12345-192.168.202.4@tcp:101:cp.0 Request processed in 828us (1260us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938782.002118:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00080000:1.0:1784938782.002838:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784938782.003441:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938782.011047:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.011162:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326052736 00000100:00100000:1.0:1784938782.011172:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326052736 00000100:00100000:1.0:1784938782.011233:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:1.0:1784938782.011254:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+45:25037:x1871643326052736:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.011475:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.011500:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a073b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56aa expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.011566:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a073c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.011581:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a073c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.011592:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a073c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.011607:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a073c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.011615:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a073c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.011622:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a073c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.011702:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a073c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.011710:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a073c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.011718:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a073c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.011724:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.011728:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a073c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.011737:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a073c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.012413:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.012419:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.012426:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a073c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.012434:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a073c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.012451:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a073c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.012457:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a073c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.012463:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a073c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.012479:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.012482:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a073c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.012490:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a073c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.012500:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xbf79d746 (ffff97473635e800) 00010000:00010000:1.0:1784938782.012502:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.012505:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a073c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.012511:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a073c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.012551:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a073b9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56aa expref: 46 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.012562:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.012565:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.012569:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a073b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56aa expref: 46 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.012578:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29000, rc 0) 00000100:00100000:1.0:1784938782.012710:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+45:25037:x1871643326052736:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1466us (1673us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.012718:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:2.0:1784938782.018236:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.018498:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326052992 00000100:00100000:0.0:1784938782.018507:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326052992 00000100:00100000:0.0:1784938782.018602:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:0.0:1784938782.018614:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+45:25037:x1871643326052992:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.018635:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.018656:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a073ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56b1 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.018809:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a073d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.018841:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a073d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.018852:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a073d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.018868:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a073dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.018875:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a073dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.018882:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a073dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938782.019642:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7:0x0], index 1: 0 00010000:00010000:0.0:1784938782.019847:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a073e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.019858:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a073e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.019867:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a073e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.019899:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a073d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.019962:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a073d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.019970:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a073d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.019984:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938782.019989:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a073d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.019996:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a073d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.020010:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938782.020013:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.020017:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a073d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.020024:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a073d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938782.020036:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000055faac60 reply state 00000000c6bc3c93 transno 4294967322 ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a073dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.020045:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938782.020079:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a073ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56b1 expref: 48 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.020093:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a073e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56b1 expref: 47 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.020101:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff974607c00200) 00010000:00010000:0.0:1784938782.020103:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938782.020106:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031c00, rc 0) 00000100:00100000:0.0:1784938782.020174:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+48:25037:x1871643326052992:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1561us (1947us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1784938782.020190:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:1.0:1784938782.024806:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.025412:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326053120 00000100:00100000:0.0:1784938782.025433:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326053120 00000100:00100000:0.0:1784938782.025494:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:0.0:1784938782.025504:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+14:10023:x1871643326053120:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.025522:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.025544:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a073f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56b8 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938782.025576:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938782.025596:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=935s v=(0 0) 00010000:00010000:0.0:1784938782.025600:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.025611:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a073f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56b8 expref: 15 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.025629:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a073f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56b8 expref: 15 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.025643:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700030a00, rc 0) 00000100:00100000:0.0:1784938782.025701:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+15:10023:x1871643326053120:12345-192.168.202.4@tcp:101:cp.0 Request processed in 198us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.025708:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:0.0:1784938782.030721:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.030811:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326053248 00000100:00100000:3.0:1784938782.030822:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326053248 00000100:00100000:3.0:1784938782.030880:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:3.0:1784938782.030891:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+15:25037:x1871643326053248:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.030911:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.030944:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000476a8c1d/0xcd9d312a94a073f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56bf expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.030979:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a073f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56b8 expref: 16 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.030988:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.030992:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.030997:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000476a8c1d/0xcd9d312a94a073f8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56bf expref: 16 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.031033:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a073f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56b8 expref: 16 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.031047:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a073f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56b8 expref: 16 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.031061:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342544384:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938782.031148:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff974735af9000 going to sleep for 11 seconds 00010000:00010000:2.0:1784938782.032501:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a073dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.032515:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a073dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.032523:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a073dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.032530:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700031400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.032535:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a073dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.032543:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a073dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.032561:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xbf79d746 (ffff974607c00500) 00010000:00010000:2.0:1784938782.032564:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.032569:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a073dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.032576:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a073dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbf79d746 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.034908:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342544384:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938782.034949:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000476a8c1d/0xcd9d312a94a073f8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56bf expref: 16 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.034974:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742173600, rc 0) 00000100:00100000:3.0:1784938782.035043:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+16:25037:x1871643326053248:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4152us (4331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.035069:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:1.0:1784938782.040918:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.041010:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326053376 00000100:00100000:0.0:1784938782.041029:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326053376 00010000:00010000:0.0:1784938782.041071:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a073f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56b8 expref: 16 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.041132:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:0.0:1784938782.041142:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735403480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+16:10024:x1871643326053376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938782.041157:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938782.041181:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a073f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56b8 expref: 16 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.041195:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a073f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56b8 expref: 16 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.041217:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a073f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56b8 expref: 16 pid: 31428 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.041235:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.041240:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.041259:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000476a8c1d/0xcd9d312a94a073f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56bf expref: 15 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.041278:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000476a8c1d/0xcd9d312a94a073f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56bf expref: 15 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.041330:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000476a8c1d/0xcd9d312a94a073f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56bf expref: 15 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.041346:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342544512:192.168.202.4@tcp:105: 00000100:00100000:0.0:1784938782.041445:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.046258:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342544512:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938782.046300:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938782.046382:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735403480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+15:10024:x1871643326053376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5240us (5482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938782.046394:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:1.0:1784938782.051231:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.051450:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326053632 00000100:00100000:2.0:1784938782.051460:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326053632 00000100:00100000:2.0:1784938782.051522:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:2.0:1784938782.051531:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+47:25037:x1871643326053632:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:2.0:1784938782.051953:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+48:25037:x1871643326053632:12345-192.168.202.4@tcp:35:cp.0 Request processed in 421us (729us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1784938782.051961:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:1.0:1784938782.070892:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.071055:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326053760 00000100:00100000:0.0:1784938782.071067:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326053760 00000100:00100000:0.0:1784938782.071129:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:0.0:1784938782.071140:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+48:25037:x1871643326053760:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.071164:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.071187:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a073ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56c6 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.071265:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07406 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.071286:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.071297:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.071586:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a0740d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.071596:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a0740d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.071605:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a0740d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.071672:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.071681:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07406 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.071701:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07406 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.071708:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700031e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938782.071713:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07406 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.071721:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07406 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.071734:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938782.071737:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.071741:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07406 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.071749:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07406 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.072012:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a0740d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.072019:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a0740d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.072025:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a0740d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.072030:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938782.072034:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a0740d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.072051:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a0740d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.072060:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xb34b709f (ffff974607c00900) 00010000:00010000:0.0:1784938782.072063:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.072066:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a0740d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.072073:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a0740d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.072113:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a073ff lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56c6 expref: 49 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.072124:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938782.072126:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.072130:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a073ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56c6 expref: 49 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.072139:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700030200, rc 0) 00000100:00100000:1.0:1784938782.072455:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+48:25037:x1871643326053760:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1315us (1572us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.072465:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:2.0:1784938782.080039:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.080123:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326053888 00000100:00100000:3.0:1784938782.080134:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326053888 00000100:00100000:3.0:1784938782.080200:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:3.0:1784938782.080211:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+48:25037:x1871643326053888:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.080237:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.080278:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172000/0xcd9d312a94a07414 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56cd expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080366:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0741b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080383:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0741b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080396:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0741b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080411:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a07422 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080430:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a07422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080436:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a07422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080509:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0741b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080537:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0741b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080544:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0741b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080550:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.080554:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0741b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080561:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0741b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080575:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.080577:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.080583:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0741b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080588:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0741b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080600:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a07422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080605:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a07422 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080610:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a07422 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080614:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.080623:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a07422 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080628:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a07422 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080635:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xb34b709f (ffff97470909e900) 00010000:00010000:3.0:1784938782.080638:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.080640:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a07422 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080646:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a07422 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080684:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172000/0xcd9d312a94a07414 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56cd expref: 49 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080694:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.080696:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.080699:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172000/0xcd9d312a94a07414 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56cd expref: 49 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.080707:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172000, rc 0) 00000100:00100000:3.0:1784938782.081044:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+48:25037:x1871643326053888:12345-192.168.202.4@tcp:101:cp.0 Request processed in 833us (1015us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938782.081053:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:3.0:1784938782.086055:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.086172:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326054144 00000100:00100000:1.0:1784938782.086184:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326054144 00000100:00100000:1.0:1784938782.086389:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:1.0:1784938782.086399:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+48:25037:x1871643326054144:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.086571:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.086599:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07429 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56d4 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.086735:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07430 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.087037:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07430 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.087051:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07430 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.087068:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07437 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xb34b709f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.087076:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.087082:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938782.088458:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8:0x0], index 0: 0 00010000:00010000:1.0:1784938782.088632:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a0743e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.088646:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a0743e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.088656:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a0743e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.088692:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07430 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.088699:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07430 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.088705:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07430 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.088711:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.088715:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07430 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.088723:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07430 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.088734:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.088737:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.088741:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07430 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.088873:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07430 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938782.088887:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000078334715 reply state 000000007271e2bd transno 4294967324 ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.088896:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938782.089038:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07429 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56d4 expref: 51 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.089054:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a0743e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56d4 expref: 50 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.089061:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff97473635e300) 00010000:00010000:1.0:1784938782.089063:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938782.089065:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f28a00, rc 0) 00000100:00100000:1.0:1784938782.089146:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:25037:x1871643326054144:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2747us (3100us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1784938782.089155:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 58 00010000:00010000:2.0:1784938782.093412:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.093431:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07437 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.093438:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07437 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.093444:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.093449:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07437 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.093456:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07437 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.093493:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xb34b709f (ffff97473635e800) 00010000:00010000:2.0:1784938782.093495:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.093500:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07437 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.093507:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07437 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xb34b709f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.095032:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.095484:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326054272 00000100:00100000:1.0:1784938782.095495:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326054272 00000100:00100000:1.0:1784938782.095550:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:1.0:1784938782.095559:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+15:10025:x1871643326054272:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.095577:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.095597:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a0744c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56db expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938782.095638:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938782.095657:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=935s v=(0 0) 00010000:00010000:1.0:1784938782.095662:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.095670:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a0744c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56db expref: 16 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.095690:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a0744c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56db expref: 16 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.095705:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29c00, rc 0) 00000100:00100000:1.0:1784938782.095915:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+16:10025:x1871643326054272:12345-192.168.202.4@tcp:101:cp.0 Request processed in 356us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.095922:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:1.0:1784938782.101332:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.101425:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326054400 00000100:00100000:3.0:1784938782.101436:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326054400 00000100:00100000:3.0:1784938782.101503:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:3.0:1784938782.101513:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+16:25037:x1871643326054400:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.101532:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.101549:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8818ac0/0xcd9d312a94a07453 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56e2 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.101583:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a0744c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56db expref: 17 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.101592:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.101597:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.101602:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8818ac0/0xcd9d312a94a07453 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56e2 expref: 17 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.101635:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a0744c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56db expref: 17 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.101649:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a0744c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56db expref: 17 pid: 31425 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.101664:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342544640:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938782.101748:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff974735af9000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938782.105072:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342544640:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938782.105112:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8818ac0/0xcd9d312a94a07453 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56e2 expref: 17 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.105159:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172000, rc 0) 00000100:00100000:3.0:1784938782.105231:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+17:25037:x1871643326054400:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3719us (3909us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.105241:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:1.0:1784938782.118688:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.119081:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326054528 00000100:00100000:0.0:1784938782.119092:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326054528 00010000:00010000:0.0:1784938782.119138:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a0744c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56db expref: 17 pid: 31425 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.119184:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:0.0:1784938782.119194:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+17:10025:x1871643326054528:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938782.119226:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938782.119259:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a0744c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56db expref: 17 pid: 31425 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.119273:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a0744c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56db expref: 17 pid: 31425 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.119295:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000352d7bea/0xcd9d312a94a0744c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56db expref: 17 pid: 31425 timeout: 1035 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.119324:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.119329:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.119338:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8818ac0/0xcd9d312a94a07453 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56e2 expref: 16 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.119348:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8818ac0/0xcd9d312a94a07453 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56e2 expref: 16 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.119387:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c8818ac0/0xcd9d312a94a07453 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56e2 expref: 16 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.119401:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342544768:192.168.202.4@tcp:105: 00000100:00100000:0.0:1784938782.119664:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a54300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938782.128977:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342544768:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938782.129005:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938782.129077:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+16:10025:x1871643326054528:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9883us (10399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.129089:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:2.0:1784938782.134503:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.134541:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.134715:0:31431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326054784 00000100:00100000:0.0:1784938782.134727:0:31431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326054784 00002000:00100000:0.0:1784938782.134810:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->39342) req@ffff97473f55ce00 x1871643326054784/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 488/0 e 0 to 0 dl 1784938793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938782.134822:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55ce00 with x1871643326054784 ext(0->39342) 00002000:00010000:0.0:1784938782.134827:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55ce00 00000100:00100000:0.0:1784938782.134847:0:31431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326054656 00000100:00100000:0.0:1784938782.134850:0:31431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326054656 00002000:00100000:0.0:1784938782.134863:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->9973) req@ffff97473f55f800 x1871643326054656/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 10464/0 e 0 to 0 dl 1784938793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938782.134872:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55f800 with x1871643326054656 ext(0->9973) 00002000:00010000:0.0:1784938782.134876:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55f800 00000100:00100000:0.0:1784938782.134887:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:0.0:1784938782.134895:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+17:10024:x1871643326054784:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938782.139720:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.140617:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+19:10024:x1871643326054784:12345-192.168.202.4@tcp:4:cp.0 Request processed in 5708us (6110us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1784938782.140633:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00002000:00100000:2.0:1784938782.140651:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->39342) req@ffff97473f55ce00 x1871643326054784/t4294967304(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 488/448 e 0 to 0 dl 1784938793 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938782.140663:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55ce00 with x1871643326054784 ext(0->39342) 00002000:00010000:2.0:1784938782.140671:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55ce00 00000100:00100000:2.0:1784938782.140705:0:31431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326055040 00000100:00100000:2.0:1784938782.140715:0:31431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326055040 00002000:00100000:2.0:1784938782.140786:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x7:0x0] (0->2658) req@ffff97472a1edc00 x1871643326055040/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 3152/0 e 0 to 0 dl 1784938793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938782.140798:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1edc00 with x1871643326055040 ext(0->2658) 00002000:00010000:2.0:1784938782.140802:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97472a1edc00 00000100:00100000:3.0:1784938782.140936:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.146409:0:31431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326054912 00000100:00100000:2.0:1784938782.146601:0:31431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326054912 00002000:00100000:2.0:1784938782.146669:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->673) req@ffff97472a1ef800 x1871643326054912/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 1168/0 e 0 to 0 dl 1784938793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938782.146704:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1ef800 with x1871643326054912 ext(0->673) 00002000:00010000:2.0:1784938782.146710:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97472a1ef800 00000100:00100000:2.0:1784938782.146743:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:2.0:1784938782.146770:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+20:10024:x1871643326054656:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938782.147465:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.147593:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326055296 00000100:00100000:3.0:1784938782.147604:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326055296 00000100:00100000:3.0:1784938782.147664:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:3.0:1784938782.147673:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+50:25037:x1871643326055296:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938782.148343:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:25037:x1871643326055296:12345-192.168.202.4@tcp:35:cp.0 Request processed in 666us (882us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1784938782.148354:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:2.0:1784938782.148412:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+22:10024:x1871643326054656:12345-192.168.202.4@tcp:4:cp.0 Request processed in 1648us (13857us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1784938782.149170:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00002000:00100000:2.0:1784938782.149184:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->9973) req@ffff97473f55f800 x1871643326054656/t4294967305(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 10464/448 e 0 to 0 dl 1784938793 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938782.149194:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55f800 with x1871643326054656 ext(0->9973) 00002000:00010000:2.0:1784938782.149201:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55f800 00000100:00100000:2.0:1784938782.149235:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:2.0:1784938782.149257:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+21:10026:x1871643326055040:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938782.153919:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:10026:x1871643326055040:12345-192.168.202.4@tcp:4:cp.0 Request processed in 4662us (14206us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1784938782.153936:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00002000:00100000:2.0:1784938782.153951:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x7:0x0] (0->2658) req@ffff97472a1edc00 x1871643326055040/t4294967306(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 3152/448 e 0 to 0 dl 1784938793 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938782.153962:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1edc00 with x1871643326055040 ext(0->2658) 00002000:00010000:2.0:1784938782.153970:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97472a1edc00 00000100:00100000:2.0:1784938782.154011:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:2.0:1784938782.154026:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+22:10026:x1871643326054912:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938782.155936:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+24:10026:x1871643326054912:12345-192.168.202.4@tcp:4:cp.0 Request processed in 1907us (14995us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784938782.155950:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00002000:00100000:2.0:1784938782.155962:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->673) req@ffff97472a1ef800 x1871643326054912/t4294967307(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 1168/448 e 0 to 0 dl 1784938793 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938782.155972:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1ef800 with x1871643326054912 ext(0->673) 00002000:00010000:2.0:1784938782.155978:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97472a1ef800 00000100:00100000:0.0:1784938782.165654:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.166943:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326055424 00000100:00100000:1.0:1784938782.166961:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326055424 00000100:00100000:1.0:1784938782.167047:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:1.0:1784938782.167060:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:25037:x1871643326055424:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.167093:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.167123:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a0745a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56e9 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.167209:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07461 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.167258:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07461 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.167275:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07461 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.167295:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07468 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.167302:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.167308:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.167393:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07461 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.167401:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07461 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.167409:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07461 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.167416:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.167422:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07461 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.167432:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07461 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.167446:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.168796:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.168807:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07461 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.168816:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a07461 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.169120:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.169127:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07468 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.169135:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07468 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.169141:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.169145:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07468 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.169152:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07468 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.169165:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9b815f19 (ffff97473635e900) 00010000:00010000:1.0:1784938782.169168:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.169171:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07468 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.169177:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07468 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.169252:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a0745a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56e9 expref: 52 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.169276:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.169279:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.169283:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a0745a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56e9 expref: 52 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.169294:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29c00, rc 0) 00000100:00100000:1.0:1784938782.169375:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:25037:x1871643326055424:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2316us (3734us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.169385:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:3.0:1784938782.183475:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.183619:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326055552 00000100:00100000:1.0:1784938782.183639:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326055552 00000100:00100000:1.0:1784938782.183741:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:1.0:1784938782.183800:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:25037:x1871643326055552:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.183842:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.183873:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a0746f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56f0 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.183998:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07476 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184016:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07476 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184029:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07476 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184046:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a0747d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184061:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a0747d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184069:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a0747d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184160:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07476 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184168:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07476 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184175:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184183:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.184188:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184196:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07476 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184210:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.184213:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.184219:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07476 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184225:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a07476 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184241:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a0747d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184266:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a0747d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184273:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a0747d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184278:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.184281:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a0747d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184288:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a0747d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184296:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9b815f19 (ffff97473635e900) 00010000:00010000:1.0:1784938782.184299:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.184302:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a0747d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184308:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a0747d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184351:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a0746f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56f0 expref: 52 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184364:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.184366:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.184370:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a0746f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56f0 expref: 52 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.184392:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29c00, rc 0) 00000100:00100000:1.0:1784938782.184494:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:25037:x1871643326055552:12345-192.168.202.4@tcp:101:cp.0 Request processed in 743us (1029us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.184948:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:0.0:1784938782.191794:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.191916:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326055808 00000100:00100000:2.0:1784938782.191928:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326055808 00000100:00100000:2.0:1784938782.191991:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:2.0:1784938782.192001:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:25037:x1871643326055808:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938782.192029:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938782.192062:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a07484 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56f7 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.192192:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a0748b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.192207:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a0748b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.192218:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a0748b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.192232:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a07492 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.192239:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a07492 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.192270:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a07492 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938782.192737:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8:0x0], index 1: 0 00010000:00010000:2.0:1784938782.192941:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a07499 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.192951:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a07499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.192959:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a07499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.192991:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a0748b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.192997:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a0748b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.193004:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a0748b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.193010:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.193015:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a0748b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.193022:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a0748b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.193035:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.193038:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.193049:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a0748b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.193055:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a0748b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938782.193069:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000326372a8 reply state 00000000093af519 transno 4294967326 ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a07492 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.193077:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938782.193108:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a07484 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56f7 expref: 54 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.193121:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a07499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56f7 expref: 53 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.193128:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff974710f9be00) 00010000:00010000:2.0:1784938782.193131:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938782.193133:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924fa00, rc 0) 00000100:00100000:2.0:1784938782.193213:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:25037:x1871643326055808:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1212us (1429us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1784938782.193221:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00010000:00010000:2.0:1784938782.198686:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a07492 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.198704:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a07492 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.198712:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a07492 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.198736:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924fe00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.198742:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a07492 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.198788:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a07492 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.198806:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9b815f19 (ffff974710f9b500) 00010000:00010000:2.0:1784938782.198809:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.198814:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a07492 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.198821:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fe00/0xcd9d312a94a07492 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9b815f19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.203781:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.203888:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326055936 00000100:00100000:1.0:1784938782.203898:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326055936 00000100:00100000:1.0:1784938782.203960:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:1.0:1784938782.203971:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+15:10023:x1871643326055936:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.203990:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.204015:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a074a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d56fe expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938782.204043:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938782.204064:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=936s v=(0 0) 00010000:00010000:1.0:1784938782.204078:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.204089:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a074a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56fe expref: 16 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.204110:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a074a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56fe expref: 16 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.204125:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29c00, rc 0) 00000100:00100000:1.0:1784938782.204195:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+16:10023:x1871643326055936:12345-192.168.202.4@tcp:101:cp.0 Request processed in 226us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.204202:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:0.0:1784938782.213044:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.217931:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326056064 00000100:00100000:3.0:1784938782.217950:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326056064 00000100:00100000:2.0:1784938782.218230:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:2.0:1784938782.218252:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+16:25037:x1871643326056064:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938782.218280:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938782.218302:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8733c47/0xcd9d312a94a074ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5705 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.218339:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a074a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56fe expref: 17 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.218349:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938782.218354:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938782.218359:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8733c47/0xcd9d312a94a074ae lrc: 4/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5705 expref: 17 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.218412:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a074a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56fe expref: 17 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.218429:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a074a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56fe expref: 17 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.218444:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f55d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342544896:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938782.218561:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.226502:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.226714:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326056192 00000100:00100000:3.0:1784938782.226725:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326056192 00010000:00010000:3.0:1784938782.226802:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a074a7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56fe expref: 18 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.226842:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:3.0:1784938782.226852:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f605180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+18:10023:x1871643326056192:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938782.226868:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938782.226921:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a074a7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56fe expref: 18 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.226936:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a074a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56fe expref: 18 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.226962:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.226967:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.226978:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8733c47/0xcd9d312a94a074ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5705 expref: 18 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.226989:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8733c47/0xcd9d312a94a074ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5705 expref: 18 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.227032:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b8733c47/0xcd9d312a94a074ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5705 expref: 18 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.227047:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342545024:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938782.227510:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974735af9000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938782.230207:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342545024:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938782.230236:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938782.230453:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f605180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+18:10023:x1871643326056192:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3600us (3959us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.230474:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00010000:00010000:0.0:1784938782.240539:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000352d7bea/0xcd9d312a94a074a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56fe expref: 17 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.240567:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f55d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342544896:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938782.240631:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8733c47/0xcd9d312a94a074ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5705 expref: 16 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.240646:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924fe00, rc 0) 00000100:00100000:0.0:1784938782.240733:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+16:25037:x1871643326056064:12345-192.168.202.4@tcp:101:cp.0 Request processed in 22492us (27700us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.240743:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:1.0:1784938782.259504:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.259558:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.259685:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.259978:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.260015:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326056448 00000100:00100000:3.0:1784938782.260027:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326056448 00002000:00100000:3.0:1784938782.260107:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->15475) req@ffff9747358faa00 x1871643326056448/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 15968/0 e 0 to 0 dl 1784938793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938782.260118:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9747358faa00 with x1871643326056448 ext(0->15475) 00002000:00010000:3.0:1784938782.260125:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9747358faa00 00000100:00100000:3.0:1784938782.260141:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326056320 00000100:00100000:3.0:1784938782.260145:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326056320 00002000:00100000:3.0:1784938782.260159:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->38516) req@ffff9747358f8000 x1871643326056320/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 488/0 e 0 to 0 dl 1784938793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938782.260167:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9747358f8000 with x1871643326056320 ext(0->38516) 00002000:00010000:3.0:1784938782.260171:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9747358f8000 00000100:00100000:3.0:1784938782.260192:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326056704 00000100:00100000:3.0:1784938782.260196:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326056704 00002000:00100000:3.0:1784938782.260210:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x7:0x0] (0->4206) req@ffff9747358f8380 x1871643326056704/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 4696/0 e 0 to 0 dl 1784938793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938782.260218:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9747358f8380 with x1871643326056704 ext(0->4206) 00002000:00010000:3.0:1784938782.260221:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9747358f8380 00000100:00100000:3.0:1784938782.260234:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:3.0:1784938782.260252:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+18:10026:x1871643326056448:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938782.261025:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+20:10026:x1871643326056448:12345-192.168.202.4@tcp:4:cp.0 Request processed in 779us (1527us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1784938782.261035:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00002000:00100000:3.0:1784938782.261042:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->15475) req@ffff9747358faa00 x1871643326056448/t4294967304(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 15968/448 e 0 to 0 dl 1784938793 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938782.261051:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9747358faa00 with x1871643326056448 ext(0->15475) 00002000:00010000:3.0:1784938782.261055:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9747358faa00 00000100:00100000:3.0:1784938782.261083:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:3.0:1784938782.261089:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+19:10026:x1871643326056320:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938782.269685:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.269725:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326056960 00000100:00100000:3.0:1784938782.269734:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326056960 00000100:00100000:3.0:1784938782.269807:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:3.0:1784938782.269818:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+53:25037:x1871643326056960:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938782.270155:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:25037:x1871643326056960:12345-192.168.202.4@tcp:35:cp.0 Request processed in 337us (480us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1784938782.270163:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:1.0:1784938782.270896:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+21:10026:x1871643326056320:12345-192.168.202.4@tcp:4:cp.0 Request processed in 9804us (11335us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1784938782.270906:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00002000:00100000:1.0:1784938782.270917:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->38516) req@ffff9747358f8000 x1871643326056320/t4294967305(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 488/448 e 0 to 0 dl 1784938793 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938782.270926:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9747358f8000 with x1871643326056320 ext(0->38516) 00002000:00010000:1.0:1784938782.270932:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9747358f8000 00000100:00100000:1.0:1784938782.270949:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326056576 00000100:00100000:1.0:1784938782.270953:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326056576 00002000:00100000:1.0:1784938782.270977:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->9197) req@ffff9747358fa300 x1871643326056576/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 9688/0 e 0 to 0 dl 1784938793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938782.270985:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9747358fa300 with x1871643326056576 ext(0->9197) 00002000:00010000:1.0:1784938782.270988:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9747358fa300 00000100:00100000:2.0:1784938782.271163:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:2.0:1784938782.271174:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+21:10024:x1871643326056704:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938782.271809:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:10024:x1871643326056704:12345-192.168.202.4@tcp:4:cp.0 Request processed in 635us (12121us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1784938782.271817:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00002000:00100000:2.0:1784938782.271825:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x7:0x0] (0->4206) req@ffff9747358f8380 x1871643326056704/t4294967306(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 4696/448 e 0 to 0 dl 1784938793 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938782.271834:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9747358f8380 with x1871643326056704 ext(0->4206) 00002000:00010000:2.0:1784938782.271838:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9747358f8380 00000100:00100000:2.0:1784938782.271856:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:2.0:1784938782.271863:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+22:10024:x1871643326056576:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938782.272122:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+24:10024:x1871643326056576:12345-192.168.202.4@tcp:4:cp.0 Request processed in 258us (12143us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784938782.272137:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00002000:00100000:2.0:1784938782.272143:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->9197) req@ffff9747358fa300 x1871643326056576/t4294967307(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:258/0 lens 9688/448 e 0 to 0 dl 1784938793 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938782.272148:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9747358fa300 with x1871643326056576 ext(0->9197) 00002000:00010000:2.0:1784938782.272151:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9747358fa300 00000100:00100000:3.0:1784938782.287662:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.287945:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326057088 00000100:00100000:1.0:1784938782.287955:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326057088 00000100:00100000:1.0:1784938782.288021:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:1.0:1784938782.288031:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:25037:x1871643326057088:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.288055:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.288089:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a074b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d570c expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288155:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288180:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288191:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288210:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288218:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288225:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288370:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288378:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288385:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288391:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.288395:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288403:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288415:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.288424:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.288430:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288437:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288450:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288456:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288462:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288467:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.288471:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288477:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288485:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe9fa0db8 (ffff97473635e000) 00010000:00010000:1.0:1784938782.288488:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.288491:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288497:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288530:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a074b5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d570c expref: 55 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288545:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.288548:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.288552:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a074b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d570c expref: 55 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.288562:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29a00, rc 0) 00000100:00100000:1.0:1784938782.288685:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:25037:x1871643326057088:12345-192.168.202.4@tcp:101:cp.0 Request processed in 655us (1031us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.288693:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:0.0:1784938782.294277:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.294462:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326057216 00000100:00100000:2.0:1784938782.294472:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326057216 00000100:00100000:2.0:1784938782.294533:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:2.0:1784938782.294542:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:25037:x1871643326057216:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938782.294563:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938782.294584:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a074ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5713 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294669:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a074d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294683:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a074d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294694:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a074d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294707:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a074d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294714:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a074d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294720:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a074d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294829:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a074d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294837:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a074d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294843:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a074d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294850:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924e000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.294854:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a074d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294862:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a074d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294874:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.294877:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.294881:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a074d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294887:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a074d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294897:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a074d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294903:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a074d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294921:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a074d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294932:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.294935:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a074d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294942:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a074d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294950:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe9fa0db8 (ffff974710f9b500) 00010000:00010000:2.0:1784938782.294952:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.294955:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a074d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294961:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f000/0xcd9d312a94a074d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.294996:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a074ca lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5713 expref: 55 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.295007:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.295009:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.295013:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a074ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5713 expref: 55 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.295021:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924f400, rc 0) 00000100:00100000:2.0:1784938782.295291:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:25037:x1871643326057216:12345-192.168.202.4@tcp:101:cp.0 Request processed in 748us (1021us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938782.295299:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:2.0:1784938782.298585:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.298817:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326057472 00000100:00100000:1.0:1784938782.298827:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326057472 00000100:00100000:1.0:1784938782.298882:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:1.0:1784938782.298891:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:25037:x1871643326057472:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.298910:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.298931:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a074df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d571a expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299057:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299084:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299096:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299111:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299125:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299131:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938782.299622:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x9:0x0], index 0: 0 00010000:00010000:1.0:1784938782.299816:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a074f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299826:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a074f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299834:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a074f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299870:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299878:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299885:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299891:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.299895:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299902:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299936:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.299938:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.299943:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.299950:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a074e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938782.299962:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b267014 reply state 00000000f07cae66 transno 4294967328 ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.299970:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938782.300000:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29a00/0xcd9d312a94a074df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d571a expref: 57 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.300013:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a074f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d571a expref: 56 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.300020:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff974705272100) 00010000:00010000:1.0:1784938782.300023:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938782.300025:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29c00, rc 0) 00000100:00100000:1.0:1784938782.300085:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:25037:x1871643326057472:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1195us (1519us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1784938782.300092:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 64 00010000:00010000:2.0:1784938782.305787:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.305797:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1784938782.305803:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.305811:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.305817:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.305822:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.305830:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.305847:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe9fa0db8 (ffff97473635e000) 00010000:00010000:2.0:1784938782.305851:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.305856:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.305861:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a074ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe9fa0db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.305872:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326057600 00000100:00100000:0.0:1784938782.305881:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326057600 00000100:00100000:0.0:1784938782.305945:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:0.0:1784938782.305956:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+24:10025:x1871643326057600:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.305974:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.305992:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a07502 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5721 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938782.306020:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938782.306039:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1784938782.306044:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.306053:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a07502 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5721 expref: 25 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.306083:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a07502 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5721 expref: 25 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.306095:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031400, rc 0) 00000100:00100000:0.0:1784938782.306167:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:10025:x1871643326057600:12345-192.168.202.4@tcp:101:cp.0 Request processed in 213us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.306175:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:0.0:1784938782.309788:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.309979:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326057728 00000100:00100000:2.0:1784938782.309990:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326057728 00000100:00100000:2.0:1784938782.311723:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:2.0:1784938782.311743:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:25037:x1871643326057728:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938782.311786:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938782.311808:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000288e091f/0xcd9d312a94a07509 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5728 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.311864:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a07502 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5721 expref: 26 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.311874:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938782.311878:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938782.311884:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000288e091f/0xcd9d312a94a07509 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5728 expref: 26 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.311932:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a07502 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5721 expref: 26 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.311948:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a07502 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5721 expref: 26 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.311962:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f605f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342545152:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938782.312070:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938782.316206:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f605f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342545152:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938782.316360:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1784938782.316444:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000288e091f/0xcd9d312a94a07509 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5728 expref: 26 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.316466:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924f000, rc 0) 00000100:00100000:0.0:1784938782.316531:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:25037:x1871643326057728:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4796us (6789us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.316540:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:1.0:1784938782.316745:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326057856 00000100:00100000:1.0:1784938782.316768:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326057856 00010000:00010000:1.0:1784938782.316801:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a07502 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5721 expref: 26 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.316852:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:1.0:1784938782.316861:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:10025:x1871643326057856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938782.316875:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938782.316901:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a07502 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5721 expref: 26 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.316925:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a07502 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5721 expref: 26 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.316949:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a07502 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5721 expref: 26 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.316963:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.316967:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.316975:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000288e091f/0xcd9d312a94a07509 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5728 expref: 25 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.316985:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000288e091f/0xcd9d312a94a07509 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5728 expref: 25 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.317019:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000288e091f/0xcd9d312a94a07509 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5728 expref: 25 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.317034:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9747358fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342545280:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938782.317487:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938782.326085:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.326182:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.326211:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326058240 00000100:00100000:3.0:1784938782.326221:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326058240 00000100:00100000:3.0:1784938782.326284:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:3.0:1784938782.326294:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705cd9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:25037:x1871643326058240:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938782.326662:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705cd9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:25037:x1871643326058240:12345-192.168.202.4@tcp:35:cp.0 Request processed in 368us (478us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1784938782.326670:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:1.0:1784938782.326990:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326057984 00000100:00100000:1.0:1784938782.326997:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326057984 00000100:00100000:1.0:1784938782.327034:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 148 00000100:00100000:1.0:1784938782.327041:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+9:24546:x1871643326057984:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938782.327050:0:30623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.327079:0:30623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974735f29a00/0xcd9d312a94a07510 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d572f expref: -99 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.327109:0:30623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974735f29a00/0xcd9d312a94a07510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d572f expref: 10 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.327121:0:30623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974735f29a00/0xcd9d312a94a07510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d572f expref: 10 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.327130:0:30623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29a00, rc 0) 00000100:00100000:1.0:1784938782.327157:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+10:24546:x1871643326057984:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 117us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.327163:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 148 00000100:00100000:2.0:1784938782.327367:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9747358fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342545280:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938782.327386:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938782.327409:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:10025:x1871643326057856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10550us (11051us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938782.327418:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:3.0:1784938782.338722:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.338815:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.339188:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326058368 00000100:00100000:2.0:1784938782.339198:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326058368 00000100:00100000:0.0:1784938782.339249:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326058496 00000100:00100000:0.0:1784938782.339254:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326058496 00000100:00100000:2.0:1784938782.339294:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 149 00000100:00100000:0.0:1784938782.339298:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:2.0:1784938782.339304:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+10:24546:x1871643326058368:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938782.339311:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:25037:x1871643326058496:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.339327:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.339347:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a07517 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5736 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339420:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0751e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339434:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0751e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339445:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0751e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339510:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a07525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339518:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a07525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339524:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a07525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339581:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0751e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.339585:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+10:24546:x1871643326058368:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 282us (873us total) trans 0 rc 0/0 00010000:00010000:0.0:1784938782.339589:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0751e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.339593:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 149 00010000:00010000:0.0:1784938782.339596:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0751e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339601:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938782.339605:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0751e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339613:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0751e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339624:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938782.339628:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.339632:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0751e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339637:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0751e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339657:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a07525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339662:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a07525 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339667:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a07525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339672:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700031a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938782.339675:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a07525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339680:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a07525 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339688:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc025ca7 (ffff974607c00f00) 00010000:00010000:0.0:1784938782.339690:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.339693:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a07525 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339698:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031a00/0xcd9d312a94a07525 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339728:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a07517 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5736 expref: 58 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339739:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938782.339741:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.339794:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a07517 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5736 expref: 58 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.339806:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700030a00, rc 0) 00000100:00100000:0.0:1784938782.339835:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:25037:x1871643326058496:12345-192.168.202.4@tcp:101:cp.0 Request processed in 532us (1020us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938782.339842:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:3.0:1784938782.345640:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.345695:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.345791:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326058624 00000100:00100000:1.0:1784938782.345812:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326058624 00000100:00100000:1.0:1784938782.345873:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:1.0:1784938782.345894:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:25037:x1871643326058624:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.345915:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.345937:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a0752c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d573d expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346006:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07533 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346032:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346050:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346402:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a0753a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346411:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a0753a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346419:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a0753a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.346478:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326058752 00000100:00100000:0.0:1784938782.346484:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326058752 00010000:00010000:1.0:1784938782.346487:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346493:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07533 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346500:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07533 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346506:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.346510:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07533 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346518:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07533 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346530:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.346539:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938782.346560:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 150 00000100:00100000:0.0:1784938782.346577:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+10:24546:x1871643326058752:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00010000:00010000:1.0:1784938782.346609:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07533 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346616:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07533 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346628:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a0753a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346633:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a0753a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346639:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a0753a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346643:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.346646:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a0753a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346651:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a0753a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346659:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc025ca7 (ffff974707d24c00) 00010000:00010000:1.0:1784938782.346661:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.346664:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a0753a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346669:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a0753a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346700:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a0752c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d573d expref: 58 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346720:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.346721:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.346725:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a0752c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d573d expref: 58 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.346733:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29200, rc 0) 00000100:00100000:1.0:1784938782.346784:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:25037:x1871643326058624:12345-192.168.202.4@tcp:101:cp.0 Request processed in 901us (1154us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938782.346784:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+10:24546:x1871643326058752:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 216us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.346791:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:0.0:1784938782.346792:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 150 00000100:00100000:3.0:1784938782.350501:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.350653:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326058880 00000100:00100000:1.0:1784938782.350666:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326058880 00000100:00100000:1.0:1784938782.350728:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 151 00000100:00100000:1.0:1784938782.350737:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+10:25039:x1871643326058880:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784938782.351015:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+10:25039:x1871643326058880:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 278us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.351024:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 151 00000100:00100000:1.0:1784938782.356280:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.356496:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326059136 00000100:00100000:3.0:1784938782.356508:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326059136 00000100:00100000:3.0:1784938782.356577:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:3.0:1784938782.356587:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:25037:x1871643326059136:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.356608:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.356633:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07541 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5744 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.356806:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a07548 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.356822:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a07548 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.356834:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a07548 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.356847:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0754f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.356855:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0754f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.356861:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0754f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938782.357337:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x9:0x0], index 1: 0 00010000:00010000:3.0:1784938782.357493:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742173c00/0xcd9d312a94a07556 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.357503:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742173c00/0xcd9d312a94a07556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.357518:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742173c00/0xcd9d312a94a07556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.357553:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a07548 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.357560:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a07548 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.357567:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a07548 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.357572:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.357577:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a07548 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.357583:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a07548 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.357596:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.357599:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.357603:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a07548 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.357609:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a07548 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938782.357623:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fbc32fc7 reply state 00000000301f627d transno 4294967330 ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0754f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.357632:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938782.357667:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07541 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5744 expref: 60 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.357681:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742173c00/0xcd9d312a94a07556 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5744 expref: 59 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.357688:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff974703b59000) 00010000:00010000:3.0:1784938782.357690:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938782.357692:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742173c00, rc 0) 00000100:00100000:3.0:1784938782.357800:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:25037:x1871643326059136:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1214us (1531us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1784938782.357808:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 67 00010000:00010000:1.0:1784938782.362923:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0754f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.362941:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0754f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.362949:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0754f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.362955:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.362975:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0754f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.362984:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0754f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.362999:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc025ca7 (ffff97470909e900) 00010000:00010000:1.0:1784938782.363003:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.363008:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0754f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.363015:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0754f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc025ca7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.368377:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.368461:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.368692:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326059264 00000100:00100000:3.0:1784938782.368703:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326059264 00000100:00100000:3.0:1784938782.368774:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:3.0:1784938782.368782:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+24:10023:x1871643326059264:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.368800:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.368821:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd52ebab/0xcd9d312a94a07564 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d574b expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938782.368848:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938782.368867:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1784938782.368872:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.368881:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd52ebab/0xcd9d312a94a07564 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d574b expref: 25 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.368897:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd52ebab/0xcd9d312a94a07564 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d574b expref: 25 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.368922:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172c00, rc 0) 00000100:00100000:3.0:1784938782.368988:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:10023:x1871643326059264:12345-192.168.202.4@tcp:101:cp.0 Request processed in 206us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.368995:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:0.0:1784938782.369579:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326059392 00000100:00100000:0.0:1784938782.369585:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326059392 00000100:00100000:0.0:1784938782.369626:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 152 00000100:00100000:0.0:1784938782.369633:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+10:25039:x1871643326059392:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938782.369849:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003631c3-aab2-48e6-bdb2-de6019261408+10:25039:x1871643326059392:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 216us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.369855:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 152 00000100:00100000:1.0:1784938782.377562:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.377642:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326059520 00000100:00100000:0.0:1784938782.377654:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326059520 00000100:00100000:0.0:1784938782.377711:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:0.0:1784938782.377721:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:25037:x1871643326059520:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.377739:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.377811:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b182753/0xcd9d312a94a0756b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5752 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.377842:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd52ebab/0xcd9d312a94a07564 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d574b expref: 26 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.377853:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.377858:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.377863:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b182753/0xcd9d312a94a0756b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5752 expref: 26 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.377897:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd52ebab/0xcd9d312a94a07564 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d574b expref: 26 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.377924:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd52ebab/0xcd9d312a94a07564 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d574b expref: 26 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.377940:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342545408:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938782.378026:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718c1fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.384678:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.384795:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326059648 00000100:00100000:3.0:1784938782.384805:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326059648 00010000:00010000:3.0:1784938782.384843:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd52ebab/0xcd9d312a94a07564 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d574b expref: 27 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.384889:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:3.0:1784938782.384898:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f607800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:10023:x1871643326059648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938782.384915:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938782.384939:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd52ebab/0xcd9d312a94a07564 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d574b expref: 27 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.384955:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd52ebab/0xcd9d312a94a07564 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d574b expref: 27 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.384982:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.384987:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.384995:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b182753/0xcd9d312a94a0756b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5752 expref: 27 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.385005:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b182753/0xcd9d312a94a0756b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5752 expref: 27 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.385059:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000b182753/0xcd9d312a94a0756b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5752 expref: 27 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.385074:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342545536:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938782.385145:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974735af9540 going to sleep for 11 seconds 00010000:00010000:0.0:1784938782.385640:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd52ebab/0xcd9d312a94a07564 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d574b expref: 27 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.385657:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342545408:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938782.385682:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b182753/0xcd9d312a94a0756b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5752 expref: 26 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.385706:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031a00, rc 0) 00000100:00100000:0.0:1784938782.386020:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:25037:x1871643326059520:12345-192.168.202.4@tcp:101:cp.0 Request processed in 8030us (8197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.386030:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:2.0:1784938782.391604:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.391819:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342545536:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938782.391852:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938782.391915:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f607800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:10023:x1871643326059648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7017us (7244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.391926:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:0.0:1784938782.392383:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326059904 00000100:00100000:0.0:1784938782.392391:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326059904 00000100:00100000:0.0:1784938782.392430:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:0.0:1784938782.392439:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:25037:x1871643326059904:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938782.392782:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:25037:x1871643326059904:12345-192.168.202.4@tcp:35:cp.0 Request processed in 342us (1187us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1784938782.392789:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:2.0:1784938782.409319:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.409506:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326060032 00000100:00100000:1.0:1784938782.409518:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326060032 00000100:00100000:1.0:1784938782.409583:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:1.0:1784938782.409593:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:25037:x1871643326060032:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.409617:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.409638:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a07572 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5759 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409701:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07579 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409715:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07579 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409745:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07579 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409784:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07580 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409791:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409798:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409862:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07579 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409871:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07579 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409878:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07579 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409885:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.409889:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07579 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409897:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07579 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409918:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.409922:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.409927:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07579 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409939:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07579 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409953:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409959:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07580 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409966:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409971:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.409975:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409981:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07580 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.409989:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xecc4f14 (ffff974707d24c00) 00010000:00010000:1.0:1784938782.409992:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.409995:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07580 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.410002:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29200/0xcd9d312a94a07580 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.410035:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a07572 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5759 expref: 61 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.410055:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.410057:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.410062:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a07572 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5759 expref: 61 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.410072:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29e00, rc 0) 00000100:00100000:1.0:1784938782.410195:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:25037:x1871643326060032:12345-192.168.202.4@tcp:101:cp.0 Request processed in 601us (885us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.410202:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:2.0:1784938782.423926:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.424054:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326060160 00000100:00100000:0.0:1784938782.424064:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326060160 00000100:00100000:0.0:1784938782.424121:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:0.0:1784938782.424130:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:25037:x1871643326060160:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.424150:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.424171:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a07587 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5760 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424253:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a0758e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424277:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a0758e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424290:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a0758e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424326:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07595 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424334:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424341:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424404:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a0758e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424411:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a0758e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424417:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a0758e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424424:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700031400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938782.424428:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a0758e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424436:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a0758e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424448:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938782.424452:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.424456:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a0758e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424463:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a0758e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424482:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424488:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07595 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424494:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07595 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424500:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938782.424503:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07595 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424509:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07595 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424517:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xecc4f14 (ffff974607c00f00) 00010000:00010000:0.0:1784938782.424519:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.424521:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07595 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424527:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07595 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424563:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a07587 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5760 expref: 61 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424572:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938782.424575:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.424584:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a07587 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5760 expref: 61 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.424594:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700030200, rc 0) 00000100:00100000:0.0:1784938782.424654:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:25037:x1871643326060160:12345-192.168.202.4@tcp:101:cp.0 Request processed in 525us (747us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938782.424661:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:2.0:1784938782.430306:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.430502:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326060416 00000100:00100000:3.0:1784938782.430514:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326060416 00000100:00100000:3.0:1784938782.430577:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:3.0:1784938782.430587:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:25037:x1871643326060416:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.430608:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.430629:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0759c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5767 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.430816:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a075a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.430831:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a075a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.430843:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a075a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.430871:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a075aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.430879:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a075aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.430885:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a075aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938782.431401:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa:0x0], index 0: 0 00010000:00010000:3.0:1784938782.431559:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a075b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.431570:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a075b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.431578:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a075b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.431612:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a075a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.431619:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a075a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.431626:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a075a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.431632:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.431637:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a075a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.431655:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a075a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.431670:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.431673:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.431678:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a075a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.431685:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a075a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938782.431699:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ccccb46 reply state 00000000df8f4d12 transno 4294967332 ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a075aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.431708:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938782.431738:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0759c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5767 expref: 63 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.431791:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a075b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5767 expref: 62 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.431799:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff974703b59700) 00010000:00010000:3.0:1784938782.431801:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938782.431804:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172e00, rc 0) 00000100:00100000:3.0:1784938782.431874:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:25037:x1871643326060416:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1287us (1579us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1784938782.431882:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 70 00010000:00010000:3.0:1784938782.436548:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a075aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.436578:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a075aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.436586:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a075aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.436591:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.436596:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a075aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.436604:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a075aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.436622:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xecc4f14 (ffff974703b59d00) 00010000:00010000:3.0:1784938782.436626:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.436631:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a075aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.436637:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a075aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xecc4f14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.438604:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.438689:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326060544 00000100:00100000:1.0:1784938782.438699:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326060544 00000100:00100000:1.0:1784938782.438790:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:1.0:1784938782.438800:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:10026:x1871643326060544:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.438819:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.438839:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000144632bd/0xcd9d312a94a075bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d576e expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938782.438866:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938782.438886:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=936s v=(0 0) 00010000:00010000:1.0:1784938782.438891:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.438900:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000144632bd/0xcd9d312a94a075bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d576e expref: 26 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.438927:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000144632bd/0xcd9d312a94a075bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d576e expref: 26 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.438959:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29e00, rc 0) 00000100:00100000:1.0:1784938782.439024:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:10026:x1871643326060544:12345-192.168.202.4@tcp:101:cp.0 Request processed in 225us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.439032:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:2.0:1784938782.443548:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.443809:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326060672 00000100:00100000:1.0:1784938782.443819:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326060672 00000100:00100000:1.0:1784938782.443882:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:1.0:1784938782.443892:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:25037:x1871643326060672:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.444093:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.444114:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3a695dc/0xcd9d312a94a075c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5775 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.444147:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000144632bd/0xcd9d312a94a075bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d576e expref: 27 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.444156:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.444160:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.444165:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3a695dc/0xcd9d312a94a075c6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5775 expref: 27 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.444197:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000144632bd/0xcd9d312a94a075bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d576e expref: 27 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.444221:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000144632bd/0xcd9d312a94a075bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d576e expref: 27 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.444261:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342545664:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938782.444358:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.447811:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.448039:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326060800 00000100:00100000:3.0:1784938782.448048:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326060800 00010000:00010000:3.0:1784938782.448092:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000144632bd/0xcd9d312a94a075bf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d576e expref: 28 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.448133:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:3.0:1784938782.448142:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:10025:x1871643326060800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938782.448159:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938782.448197:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000144632bd/0xcd9d312a94a075bf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d576e expref: 28 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.448211:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000144632bd/0xcd9d312a94a075bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d576e expref: 28 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.448238:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.448253:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.448263:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3a695dc/0xcd9d312a94a075c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5775 expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.448281:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3a695dc/0xcd9d312a94a075c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5775 expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.448325:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b3a695dc/0xcd9d312a94a075c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5775 expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.448341:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342545792:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938782.448422:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974735af9540 going to sleep for 11 seconds 00010000:00010000:1.0:1784938782.448941:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000144632bd/0xcd9d312a94a075bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d576e expref: 28 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.448960:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342545664:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938782.448985:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3a695dc/0xcd9d312a94a075c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5775 expref: 27 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.448996:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29200, rc 0) 00000100:00100000:1.0:1784938782.449041:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:25037:x1871643326060672:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5151us (5503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.449049:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:3.0:1784938782.454485:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342545792:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938782.454521:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938782.454589:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:10025:x1871643326060800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6447us (6788us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.454601:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:3.0:1784938782.455562:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.455635:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326061056 00000100:00100000:0.0:1784938782.455645:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326061056 00000100:00100000:0.0:1784938782.455699:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:0.0:1784938782.455709:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:25037:x1871643326061056:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938782.456086:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:25037:x1871643326061056:12345-192.168.202.4@tcp:35:cp.0 Request processed in 376us (526us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1784938782.456094:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:0.0:1784938782.461539:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.461645:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326061184 00000100:00100000:1.0:1784938782.461655:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326061184 00000100:00100000:1.0:1784938782.461719:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:1.0:1784938782.461730:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:25037:x1871643326061184:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.461793:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.461818:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a075cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d577c expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.461889:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a075d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.461936:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a075d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.461948:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a075d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.461965:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.461972:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.461979:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462042:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a075d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462050:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a075d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462056:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a075d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462062:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.462066:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a075d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462073:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a075d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462085:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.462093:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.462099:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a075d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462105:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a075d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462119:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462125:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462131:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462136:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.462139:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462145:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462152:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x712be7d1 (ffff974707d24700) 00010000:00010000:1.0:1784938782.462154:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.462157:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462162:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462198:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a075cd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d577c expref: 64 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462229:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.462232:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.462237:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a075cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d577c expref: 64 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.462256:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29e00, rc 0) 00000100:00100000:1.0:1784938782.462322:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:25037:x1871643326061184:12345-192.168.202.4@tcp:101:cp.0 Request processed in 593us (793us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.462330:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:2.0:1784938782.469793:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.469885:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326061312 00000100:00100000:0.0:1784938782.469895:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326061312 00000100:00100000:0.0:1784938782.470017:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:0.0:1784938782.470027:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:25037:x1871643326061312:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.470051:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.470073:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a075e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5783 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470164:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a075e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470179:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a075e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470201:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a075e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470215:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a075f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470222:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a075f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470229:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a075f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470326:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a075e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470334:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a075e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470339:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a075e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470345:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938782.470349:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a075e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470357:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a075e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470369:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938782.470372:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.470377:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a075e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470390:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a075e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470406:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a075f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470412:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a075f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470418:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a075f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470422:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938782.470425:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a075f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470431:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a075f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470439:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x712be7d1 (ffff974607c00f00) 00010000:00010000:0.0:1784938782.470442:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.470444:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a075f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470449:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a075f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470484:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a075e2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5783 expref: 64 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470505:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938782.470508:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.470512:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a075e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5783 expref: 64 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.470521:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031400, rc 0) 00000100:00100000:0.0:1784938782.470586:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:25037:x1871643326061312:12345-192.168.202.4@tcp:101:cp.0 Request processed in 560us (846us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938782.470593:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:2.0:1784938782.475853:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.477163:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326061568 00000100:00100000:1.0:1784938782.477176:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326061568 00000100:00100000:1.0:1784938782.477257:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:1.0:1784938782.477276:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:25037:x1871643326061568:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.477298:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.477328:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a075f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d578a expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.477471:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.477487:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.477499:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.477514:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07605 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.477535:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07605 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.477543:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07605 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938782.478124:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa:0x0], index 1: 0 00010000:00010000:1.0:1784938782.478294:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569200/0xcd9d312a94a0760c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.478305:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569200/0xcd9d312a94a0760c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.478314:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569200/0xcd9d312a94a0760c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.478349:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.478356:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.478363:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.478369:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.478375:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.478383:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.478407:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.478410:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.478415:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.478423:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a075fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938782.478436:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009530bea4 reply state 00000000a02f10a7 transno 4294967334 ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07605 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.478446:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938782.478477:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a075f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d578a expref: 66 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.478492:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569200/0xcd9d312a94a0760c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d578a expref: 65 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.478500:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14:0x0].0x0 (ffff974707d24800) 00010000:00010000:1.0:1784938782.478503:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938782.478505:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569200, rc 0) 00000100:00100000:1.0:1784938782.478577:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+66:25037:x1871643326061568:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1303us (2734us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1784938782.478585:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:2.0:1784938782.487838:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.488283:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326061696 00000100:00100000:0.0:1784938782.488295:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326061696 00000100:00100000:0.0:1784938782.488369:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:0.0:1784938782.488380:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:10023:x1871643326061696:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.488401:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.488429:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0761a lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5791 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938782.488466:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938782.488490:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1784938782.488495:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.488506:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0761a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5791 expref: 26 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.488526:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0761a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5791 expref: 26 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.488560:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700030a00, rc 0) 00000100:00100000:0.0:1784938782.488623:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:10023:x1871643326061696:12345-192.168.202.4@tcp:101:cp.0 Request processed in 244us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.488629:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 44 00010000:00010000:1.0:1784938782.489054:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07605 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.489066:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07605 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.489084:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07605 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.489091:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.489095:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07605 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.489104:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07605 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.489119:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x712be7d1 (ffff974707d24700) 00010000:00010000:1.0:1784938782.489123:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.489130:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07605 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.489137:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a07605 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x712be7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.493010:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.493078:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326061824 00000100:00100000:1.0:1784938782.493089:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326061824 00000100:00100000:1.0:1784938782.493156:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:1.0:1784938782.493166:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:25037:x1871643326061824:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.493188:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.493222:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba2a2a0e/0xcd9d312a94a07621 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5798 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.493487:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0761a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5791 expref: 27 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.493517:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.493521:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.493526:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba2a2a0e/0xcd9d312a94a07621 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5798 expref: 27 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.493563:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0761a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5791 expref: 27 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.493579:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0761a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5791 expref: 27 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.493593:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342545920:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938782.493678:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938782.497616:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.497685:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326061952 00000100:00100000:3.0:1784938782.497709:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326061952 00010000:00010000:3.0:1784938782.497774:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0761a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5791 expref: 28 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.497818:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:3.0:1784938782.497827:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:10024:x1871643326061952:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938782.497842:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938782.497866:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0761a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5791 expref: 28 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.497880:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0761a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5791 expref: 28 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.497919:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.497924:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.497933:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba2a2a0e/0xcd9d312a94a07621 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5798 expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.497943:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba2a2a0e/0xcd9d312a94a07621 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5798 expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.497982:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ba2a2a0e/0xcd9d312a94a07621 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5798 expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.497995:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342546048:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938782.498301:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0761a lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5791 expref: 28 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.498327:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342545920:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938782.498352:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba2a2a0e/0xcd9d312a94a07621 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5798 expref: 27 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.498363:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568200, rc 0) 00000100:00100000:3.0:1784938782.498688:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747183189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938782.498789:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:25037:x1871643326061824:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5623us (6049us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.498808:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:2.0:1784938782.503025:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.503222:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342546048:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938782.503256:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938782.503322:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:10024:x1871643326061952:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5496us (5715us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.503334:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:0.0:1784938782.504629:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326062208 00000100:00100000:0.0:1784938782.504646:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326062208 00000100:00100000:0.0:1784938782.504702:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:0.0:1784938782.504713:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+65:25037:x1871643326062208:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938782.505282:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+66:25037:x1871643326062208:12345-192.168.202.4@tcp:35:cp.0 Request processed in 567us (2265us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1784938782.505292:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:2.0:1784938782.510159:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.510292:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326062336 00000100:00100000:3.0:1784938782.510302:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326062336 00000100:00100000:3.0:1784938782.510366:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00100000:3.0:1784938782.510377:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+66:25037:x1871643326062336:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.510409:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.510436:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a07628 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d579f expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510506:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0762f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510522:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0762f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510535:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0762f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510592:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07636 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510600:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510607:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510706:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0762f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510714:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0762f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510720:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0762f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510726:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.510730:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0762f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510737:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0762f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510776:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.510779:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.510784:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0762f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510790:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0762f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510804:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510810:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07636 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510816:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510830:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.510833:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510839:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07636 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510849:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4ee593e6 (ffff974703b59d00) 00010000:00010000:3.0:1784938782.510851:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.510854:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07636 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510860:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07636 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510896:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a07628 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d579f expref: 67 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510906:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.510909:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.510913:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a07628 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d579f expref: 67 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.510922:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172600, rc 0) 00000100:00100000:3.0:1784938782.510999:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+66:25037:x1871643326062336:12345-192.168.202.4@tcp:101:cp.0 Request processed in 624us (851us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938782.511008:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00100000:2.0:1784938782.515153:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.515254:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326062464 00000100:00100000:3.0:1784938782.515286:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326062464 00000100:00100000:3.0:1784938782.515356:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:3.0:1784938782.515366:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+66:25037:x1871643326062464:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.515389:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.515412:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0763d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d57a6 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515484:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07644 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515499:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07644 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515511:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07644 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515526:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0764b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515533:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0764b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515539:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0764b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515616:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07644 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515624:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07644 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515631:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07644 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515643:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.515650:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07644 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515657:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07644 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515671:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.515674:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.515679:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07644 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515686:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a07644 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515705:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0764b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515710:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0764b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515715:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0764b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515720:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.515724:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0764b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515729:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0764b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515794:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4ee593e6 (ffff974703b59300) 00010000:00010000:3.0:1784938782.515798:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.515802:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0764b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515808:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0764b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515845:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0763d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57a6 expref: 67 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515855:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.515858:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.515862:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0763d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57a6 expref: 67 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.515871:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172a00, rc 0) 00000100:00100000:3.0:1784938782.516498:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+66:25037:x1871643326062464:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1131us (1351us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938782.516508:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:2.0:1784938782.521005:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.521633:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326062720 00000100:00100000:0.0:1784938782.521643:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326062720 00000100:00100000:0.0:1784938782.521711:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:0.0:1784938782.521722:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+66:25037:x1871643326062720:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.521744:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.521802:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a07652 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d57ad expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.521941:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a07659 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.521957:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a07659 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.521988:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a07659 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.522004:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07660 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.522011:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.522017:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938782.522951:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb:0x0], index 0: 0 00010000:00010000:0.0:1784938782.523116:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07667 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.523128:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.523138:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.523172:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a07659 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.523179:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a07659 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.523185:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a07659 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.523191:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938782.523202:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a07659 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.523478:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a07659 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.523496:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938782.523499:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.523504:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a07659 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.523511:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a07659 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938782.523528:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e9aa42e reply state 00000000c8a70569 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.523537:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938782.523573:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a07652 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57ad expref: 69 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.523587:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57ad expref: 68 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.523595:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff974711893e00) 00010000:00010000:0.0:1784938782.523597:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938782.523599:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031e00, rc 0) 00000100:00100000:0.0:1784938782.523734:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+69:25037:x1871643326062720:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2013us (2737us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1784938782.523742:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:2.0:1784938782.529237:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.529326:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326062848 00000100:00100000:0.0:1784938782.529337:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326062848 00000100:00100000:0.0:1784938782.529397:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:0.0:1784938782.529407:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:10025:x1871643326062848:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.529425:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.529447:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbfde065/0xcd9d312a94a07675 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d57b4 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938782.529475:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938782.529493:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1784938782.529498:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.529507:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbfde065/0xcd9d312a94a07675 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57b4 expref: 27 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.529524:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bbfde065/0xcd9d312a94a07675 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57b4 expref: 27 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.529537:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700030a00, rc 0) 00000100:00100000:0.0:1784938782.529599:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:10025:x1871643326062848:12345-192.168.202.4@tcp:101:cp.0 Request processed in 192us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.529606:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 46 00010000:00010000:3.0:1784938782.532814:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.532831:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07660 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.532839:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.532866:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.532871:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.532879:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07660 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.532896:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4ee593e6 (ffff974607c00f00) 00010000:00010000:3.0:1784938782.532899:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.532903:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07660 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.532910:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a07660 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4ee593e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.534584:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.534788:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326062976 00000100:00100000:1.0:1784938782.534798:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326062976 00000100:00100000:1.0:1784938782.534852:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:1.0:1784938782.534860:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:25037:x1871643326062976:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.534880:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.534898:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcc05294/0xcd9d312a94a0767c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d57bb expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.534932:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbfde065/0xcd9d312a94a07675 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57b4 expref: 28 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.534941:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.534946:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.534951:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc05294/0xcd9d312a94a0767c lrc: 4/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57bb expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.534983:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bbfde065/0xcd9d312a94a07675 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57b4 expref: 28 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.534998:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bbfde065/0xcd9d312a94a07675 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57b4 expref: 28 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.535011:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342546176:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938782.535095:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.538863:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.538951:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326063104 00000100:00100000:3.0:1784938782.538960:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326063104 00010000:00010000:3.0:1784938782.539001:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bbfde065/0xcd9d312a94a07675 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57b4 expref: 29 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.539036:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:3.0:1784938782.539046:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f605f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10026:x1871643326063104:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938782.539063:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938782.539086:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bbfde065/0xcd9d312a94a07675 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57b4 expref: 29 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.539102:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bbfde065/0xcd9d312a94a07675 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57b4 expref: 29 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.539144:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.539150:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.539159:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bcc05294/0xcd9d312a94a0767c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57bb expref: 29 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.539169:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc05294/0xcd9d312a94a0767c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57bb expref: 29 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.539205:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bcc05294/0xcd9d312a94a0767c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57bb expref: 29 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.539220:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342546304:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938782.539327:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747183189c0 going to sleep for 11 seconds 00010000:00010000:1.0:1784938782.539418:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbfde065/0xcd9d312a94a07675 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57b4 expref: 29 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.539434:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d60380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342546176:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938782.539460:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bcc05294/0xcd9d312a94a0767c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57bb expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.539471:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569400, rc 0) 00000100:00100000:1.0:1784938782.539502:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:25037:x1871643326062976:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4643us (4929us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.539511:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:2.0:1784938782.546330:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.546467:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342546304:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938782.546493:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938782.546553:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f605f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:10026:x1871643326063104:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7507us (7698us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.546565:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:0.0:1784938782.551676:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326063360 00000100:00100000:0.0:1784938782.551693:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326063360 00000100:00100000:0.0:1784938782.551789:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:0.0:1784938782.551801:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+68:25037:x1871643326063360:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938782.552170:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+69:25037:x1871643326063360:12345-192.168.202.4@tcp:35:cp.0 Request processed in 369us (5860us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1784938782.552192:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:1.0:1784938782.556516:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.556608:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326063488 00000100:00100000:3.0:1784938782.556618:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326063488 00000100:00100000:3.0:1784938782.556680:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:3.0:1784938782.556691:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+69:25037:x1871643326063488:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.556722:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.556747:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07683 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d57c2 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.556867:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0768a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.556882:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0768a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.556893:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0768a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.556935:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07691 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.556943:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.556950:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557017:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0768a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557025:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0768a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557030:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0768a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557036:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.557040:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0768a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557057:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0768a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557068:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.557071:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.557076:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0768a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557083:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0768a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557096:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557103:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07691 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557109:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07691 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557115:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.557117:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07691 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557123:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07691 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557130:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xf0a46efb (ffff974703b59300) 00010000:00010000:3.0:1784938782.557132:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.557134:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07691 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557152:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07691 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557190:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07683 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57c2 expref: 70 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557199:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.557201:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.557204:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a07683 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57c2 expref: 70 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.557227:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01600, rc 0) 00000100:00100000:3.0:1784938782.557297:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+69:25037:x1871643326063488:12345-192.168.202.4@tcp:101:cp.0 Request processed in 608us (790us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938782.557469:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:2.0:1784938782.564193:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.564627:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326063616 00000100:00100000:0.0:1784938782.564641:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326063616 00000100:00100000:0.0:1784938782.564710:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:0.0:1784938782.564721:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+69:25037:x1871643326063616:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.564746:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.564811:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a07698 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d57c9 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.564890:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0769f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.564905:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0769f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.564927:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0769f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.564943:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a076a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.564949:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a076a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.564955:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a076a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565018:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0769f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565042:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0769f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565048:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0769f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565053:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938782.565057:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0769f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565065:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0769f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565077:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938782.565080:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.565084:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0769f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565091:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030200/0xcd9d312a94a0769f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565106:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a076a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565112:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a076a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565118:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a076a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565122:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938782.565134:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a076a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565140:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a076a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565148:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xf0a46efb (ffff974711893b00) 00010000:00010000:0.0:1784938782.565150:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.565153:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a076a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565158:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030a00/0xcd9d312a94a076a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565192:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a07698 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57c9 expref: 70 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565202:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938782.565205:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.565457:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031400/0xcd9d312a94a07698 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57c9 expref: 70 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.565471:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031400, rc 0) 00000100:00100000:0.0:1784938782.565537:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+69:25037:x1871643326063616:12345-192.168.202.4@tcp:101:cp.0 Request processed in 817us (1353us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938782.565545:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:2.0:1784938782.571427:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.571626:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326063872 00000100:00100000:3.0:1784938782.571636:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326063872 00000100:00100000:3.0:1784938782.571707:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:3.0:1784938782.571717:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+69:25037:x1871643326063872:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.571741:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.571806:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a076ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d57d0 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.572144:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a076b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.572160:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a076b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.572181:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a076b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.572197:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a076bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.572205:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a076bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.572211:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a076bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938782.574502:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb:0x0], index 1: 0 00010000:00010000:2.0:1784938782.574703:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a076c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.574719:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a076c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.574735:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a076c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.575026:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a076b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.575035:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a076b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.575042:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a076b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.575049:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.575053:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a076b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.575061:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a076b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.575074:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.575077:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.575082:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a076b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.575089:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a076b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938782.575124:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009aa61d81 reply state 0000000018489514 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a076bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.575135:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938782.575178:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a076ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57d0 expref: 72 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.575195:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a076c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57d0 expref: 71 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.575203:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x16:0x0].0x0 (ffff974710f9b500) 00010000:00010000:2.0:1784938782.575206:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938782.575208:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924fc00, rc 0) 00000100:00100000:2.0:1784938782.575518:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+72:25037:x1871643326063872:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3800us (4099us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1784938782.575527:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:1.0:1784938782.582200:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.582388:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326064000 00000100:00100000:0.0:1784938782.582399:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326064000 00000100:00100000:0.0:1784938782.582460:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:0.0:1784938782.582470:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:10023:x1871643326064000:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.582504:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.582525:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a076d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d57d7 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938782.582552:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938782.582570:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1784938782.582575:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.582584:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a076d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57d7 expref: 27 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.582601:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a076d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57d7 expref: 27 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.582614:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031400, rc 0) 00000100:00100000:0.0:1784938782.582671:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:10023:x1871643326064000:12345-192.168.202.4@tcp:101:cp.0 Request processed in 202us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.582679:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 48 00010000:00010000:2.0:1784938782.583126:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a076bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.583136:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a076bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.583143:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a076bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.583150:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.583155:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a076bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.583176:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a076bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.583189:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xf0a46efb (ffff974703b59300) 00010000:00010000:2.0:1784938782.583192:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.583196:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a076bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.583202:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a076bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xf0a46efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.587859:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.587935:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326064128 00000100:00100000:1.0:1784938782.587945:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326064128 00000100:00100000:1.0:1784938782.588009:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:1.0:1784938782.588019:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:25037:x1871643326064128:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.588038:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.588057:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee29a2fb/0xcd9d312a94a076d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d57de expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.588088:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a076d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57d7 expref: 28 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.588097:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.588102:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.588130:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee29a2fb/0xcd9d312a94a076d7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57de expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.588163:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a076d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57d7 expref: 28 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.588176:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a076d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57d7 expref: 28 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.588189:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342546432:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938782.588678:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.595931:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.596149:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326064256 00000100:00100000:3.0:1784938782.596159:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326064256 00010000:00010000:3.0:1784938782.596201:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a076d0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57d7 expref: 29 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.596267:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:3.0:1784938782.596277:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10024:x1871643326064256:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938782.596293:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938782.596329:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a076d0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57d7 expref: 29 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.596344:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a076d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57d7 expref: 29 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.596370:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.596387:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.596396:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee29a2fb/0xcd9d312a94a076d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57de expref: 29 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.596406:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee29a2fb/0xcd9d312a94a076d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57de expref: 29 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.596447:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee29a2fb/0xcd9d312a94a076d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57de expref: 29 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.596462:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342546560:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938782.596555:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938782.599730:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342546560:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938782.599785:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938782.599836:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10024:x1871643326064256:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3560us (3915us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.599847:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00010000:00010000:1.0:1784938782.601857:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a076d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57d7 expref: 28 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.601882:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974607d61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342546432:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938782.601913:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee29a2fb/0xcd9d312a94a076d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57de expref: 27 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.601929:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568e00, rc 0) 00000100:00100000:1.0:1784938782.602081:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:25037:x1871643326064128:12345-192.168.202.4@tcp:101:cp.0 Request processed in 14063us (14231us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.602090:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:0.0:1784938782.606064:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.606167:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326064512 00000100:00100000:3.0:1784938782.606178:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326064512 00000100:00100000:3.0:1784938782.606432:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:3.0:1784938782.606442:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+71:25037:x1871643326064512:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938782.606955:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+72:25037:x1871643326064512:12345-192.168.202.4@tcp:35:cp.0 Request processed in 512us (900us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1784938782.606964:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:2.0:1784938782.611646:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.611731:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326064640 00000100:00100000:1.0:1784938782.611741:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326064640 00000100:00100000:1.0:1784938782.611816:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:1.0:1784938782.611825:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+72:25037:x1871643326064640:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.611863:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.611885:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a076de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d57e5 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.611948:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a076e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.611962:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a076e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.611973:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a076e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.611987:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a076ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.611994:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a076ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612001:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a076ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612062:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a076e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612069:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a076e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612076:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a076e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612081:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.612091:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a076e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612099:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a076e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612111:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.612114:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.612118:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a076e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612124:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a076e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612136:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a076ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612142:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a076ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612149:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a076ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612154:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.612156:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a076ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612161:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a076ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612168:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x267dbf88 (ffff974707d24700) 00010000:00010000:1.0:1784938782.612170:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.612180:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a076ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612185:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a076ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612230:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a076de lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57e5 expref: 73 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612274:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.612277:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.612281:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a076de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57e5 expref: 73 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.612291:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568600, rc 0) 00000100:00100000:1.0:1784938782.612365:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+72:25037:x1871643326064640:12345-192.168.202.4@tcp:101:cp.0 Request processed in 540us (729us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.612372:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:2.0:1784938782.616682:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.616867:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326064768 00000100:00100000:3.0:1784938782.616877:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326064768 00000100:00100000:3.0:1784938782.617025:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:3.0:1784938782.617035:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+72:25037:x1871643326064768:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.617058:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.617078:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a076f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d57ec expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617138:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a076fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617151:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a076fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617163:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a076fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617177:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a07701 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617184:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a07701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617190:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a07701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617443:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a076fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617452:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a076fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617459:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a076fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617476:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.617482:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a076fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617491:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a076fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617506:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.617509:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.617513:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a076fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617519:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a076fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617535:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a07701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617541:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a07701 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617548:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a07701 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617553:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.617556:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a07701 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617562:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a07701 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617580:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x267dbf88 (ffff974703b59d00) 00010000:00010000:3.0:1784938782.617582:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.617585:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a07701 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617592:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a07701 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617632:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a076f3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57ec expref: 73 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617643:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.617645:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.617649:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a076f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57ec expref: 73 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.617659:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172a00, rc 0) 00000100:00100000:3.0:1784938782.617801:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+72:25037:x1871643326064768:12345-192.168.202.4@tcp:101:cp.0 Request processed in 766us (1129us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938782.617809:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:0.0:1784938782.622296:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.622411:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326065024 00000100:00100000:3.0:1784938782.622422:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326065024 00000100:00100000:3.0:1784938782.622481:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:3.0:1784938782.622491:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+72:25037:x1871643326065024:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.622511:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.622532:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07708 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d57f3 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.622681:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0770f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.622695:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0770f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.622707:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0770f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.622724:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07716 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.622732:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.622739:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938782.623266:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc:0x0], index 0: 0 00010000:00010000:3.0:1784938782.623724:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a200/0xcd9d312a94a0771d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.623736:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a200/0xcd9d312a94a0771d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.623744:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a200/0xcd9d312a94a0771d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.623808:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0770f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.623827:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0770f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.623833:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0770f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.623838:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.623842:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0770f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.623849:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0770f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.623862:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.623864:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.623869:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0770f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.623875:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0770f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938782.623889:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009f768dec reply state 00000000ca492113 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.623898:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938782.624181:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a07708 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57f3 expref: 75 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.624197:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a200/0xcd9d312a94a0771d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57f3 expref: 74 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.624227:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff974703b59200) 00010000:00010000:3.0:1784938782.624229:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938782.624232:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209a200, rc 0) 00000100:00100000:1.0:1784938782.625572:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+75:25037:x1871643326065024:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3075us (3278us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1784938782.625584:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 82 00010000:00010000:3.0:1784938782.629279:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.629296:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07716 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.629303:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07716 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.629318:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209aa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.629323:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07716 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.629332:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07716 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.629349:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x267dbf88 (ffff974703b59a00) 00010000:00010000:3.0:1784938782.629352:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.629357:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07716 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.629364:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07716 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x267dbf88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.630732:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.631118:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326065152 00000100:00100000:1.0:1784938782.631128:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326065152 00000100:00100000:1.0:1784938782.631184:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:1.0:1784938782.631193:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:10026:x1871643326065152:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.631222:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.631253:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a0772b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d57fa expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938782.631311:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938782.631331:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=936s v=(0 0) 00010000:00010000:1.0:1784938782.631336:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.631345:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a0772b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57fa expref: 28 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.631363:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a0772b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57fa expref: 28 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.631376:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568600, rc 0) 00000100:00100000:1.0:1784938782.631476:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:10026:x1871643326065152:12345-192.168.202.4@tcp:101:cp.0 Request processed in 284us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.631483:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:2.0:1784938782.638074:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.638401:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326065280 00000100:00100000:0.0:1784938782.638411:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326065280 00000100:00100000:0.0:1784938782.638509:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:0.0:1784938782.638520:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:25037:x1871643326065280:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.638539:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.638557:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7004140/0xcd9d312a94a07732 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5801 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.638606:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a0772b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57fa expref: 29 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.638616:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.638620:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.638626:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7004140/0xcd9d312a94a07732 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5801 expref: 29 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.638662:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a0772b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57fa expref: 29 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.638676:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a0772b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57fa expref: 29 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.638691:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342546688:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938782.638811:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff974717fb5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938782.641666:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342546688:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938782.641706:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7004140/0xcd9d312a94a07732 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5801 expref: 29 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.641727:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700030200, rc 0) 00000100:00100000:0.0:1784938782.641816:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:25037:x1871643326065280:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3297us (3751us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.641825:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:2.0:1784938782.646502:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.646595:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326065408 00000100:00100000:3.0:1784938782.646604:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326065408 00010000:00010000:3.0:1784938782.646669:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a0772b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57fa expref: 29 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.646718:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:3.0:1784938782.646728:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10026:x1871643326065408:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938782.646778:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938782.646806:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a0772b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57fa expref: 29 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.646820:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a0772b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57fa expref: 29 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.646845:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a0772b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57fa expref: 29 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.646863:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.646867:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.646876:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7004140/0xcd9d312a94a07732 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5801 expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.646885:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7004140/0xcd9d312a94a07732 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5801 expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.646936:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a7004140/0xcd9d312a94a07732 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5801 expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.646962:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342546816:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938782.647048:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.653822:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.653922:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326065664 00000100:00100000:0.0:1784938782.653931:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326065664 00000100:00100000:0.0:1784938782.653988:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:0.0:1784938782.653997:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705cda450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+74:25037:x1871643326065664:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938782.654397:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705cda450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+75:25037:x1871643326065664:12345-192.168.202.4@tcp:35:cp.0 Request processed in 400us (583us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1784938782.654405:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:3.0:1784938782.654696:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342546816:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938782.654718:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938782.654777:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:10026:x1871643326065408:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8025us (8260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.654785:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:2.0:1784938782.660596:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.660690:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326065792 00000100:00100000:3.0:1784938782.660701:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326065792 00000100:00100000:3.0:1784938782.660797:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:3.0:1784938782.660807:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+75:25037:x1871643326065792:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.660836:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.660857:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07739 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5808 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.660937:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07740 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.660953:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07740 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.660964:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07740 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.660980:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07747 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661007:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661014:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661081:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07740 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661088:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07740 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661094:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07740 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661099:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.661103:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07740 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661110:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07740 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661120:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.661124:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.661128:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07740 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661133:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07740 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661146:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661156:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07747 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661162:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07747 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661167:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209b800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.661170:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07747 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661176:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07747 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661183:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd946e4d2 (ffff974703b59a00) 00010000:00010000:3.0:1784938782.661185:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.661188:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07747 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661194:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07747 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661226:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07739 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5808 expref: 76 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661236:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.661249:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.661254:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07739 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5808 expref: 76 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.661273:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209aa00, rc 0) 00000100:00100000:3.0:1784938782.661578:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+75:25037:x1871643326065792:12345-192.168.202.4@tcp:101:cp.0 Request processed in 771us (993us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938782.661587:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:2.0:1784938782.665500:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.665616:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326065920 00000100:00100000:1.0:1784938782.665626:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326065920 00000100:00100000:1.0:1784938782.665733:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:1.0:1784938782.665745:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+75:25037:x1871643326065920:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.665795:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.665816:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a0774e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d580f expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666021:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a07755 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666038:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a07755 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666057:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a07755 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666074:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0775c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666081:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0775c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666087:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0775c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666151:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a07755 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666159:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a07755 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666165:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a07755 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666171:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.666175:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a07755 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666183:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a07755 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666196:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.666199:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.666204:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a07755 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666416:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a07755 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666430:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0775c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666435:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0775c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666441:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0775c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666446:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.666449:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0775c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666456:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0775c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666465:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd946e4d2 (ffff974707d24000) 00010000:00010000:1.0:1784938782.666469:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.666472:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0775c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666478:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0775c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666515:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a0774e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d580f expref: 76 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666539:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.666541:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.666545:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a0774e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d580f expref: 76 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.666555:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568400, rc 0) 00000100:00100000:1.0:1784938782.666680:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+75:25037:x1871643326065920:12345-192.168.202.4@tcp:101:cp.0 Request processed in 935us (1191us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.666689:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:2.0:1784938782.670553:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.670650:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326066176 00000100:00100000:3.0:1784938782.670659:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326066176 00000100:00100000:3.0:1784938782.670793:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:3.0:1784938782.670802:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+75:25037:x1871643326066176:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.670823:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.670843:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07763 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5816 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.671011:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a0776a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.671025:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a0776a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.671037:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a0776a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.671051:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07771 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.671056:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07771 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.671062:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07771 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938782.671730:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc:0x0], index 1: 0 00010000:00010000:3.0:1784938782.672741:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b000/0xcd9d312a94a07778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.672839:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b000/0xcd9d312a94a07778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.672850:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b000/0xcd9d312a94a07778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.672892:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a0776a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.672899:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a0776a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.672905:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a0776a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.672972:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209b800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.672977:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a0776a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.672986:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a0776a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.673000:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938782.673004:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.673010:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a0776a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.673030:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a0776a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938782.673046:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096259c59 reply state 000000003b1297cc transno 4294967342 ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07771 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.673055:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938782.673092:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07763 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5816 expref: 78 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.673107:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b000/0xcd9d312a94a07778 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5816 expref: 77 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.673115:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x18:0x0].0x0 (ffff974703b59d00) 00010000:00010000:3.0:1784938782.673117:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938782.673119:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209b000, rc 0) 00000100:00100000:3.0:1784938782.673188:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+78:25037:x1871643326066176:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2385us (2643us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1784938782.673196:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:3.0:1784938782.678880:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.678960:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326066304 00000100:00100000:0.0:1784938782.678970:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326066304 00000100:00100000:0.0:1784938782.679037:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:0.0:1784938782.679049:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:10024:x1871643326066304:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.679068:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.679094:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a07786 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d581d expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938782.679122:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938782.679144:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1784938782.679148:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.679158:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a07786 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d581d expref: 28 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.679174:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a07786 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d581d expref: 28 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.679186:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031400, rc 0) 00000100:00100000:0.0:1784938782.679254:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:10024:x1871643326066304:12345-192.168.202.4@tcp:101:cp.0 Request processed in 207us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.679282:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:1.0:1784938782.683215:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.683298:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326066432 00000100:00100000:0.0:1784938782.683319:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326066432 00000100:00100000:0.0:1784938782.683380:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:0.0:1784938782.683390:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:25037:x1871643326066432:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.683409:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.683427:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0778d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5824 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.683458:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a07786 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d581d expref: 29 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.683467:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.683471:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.683477:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0778d lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5824 expref: 29 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.683511:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a07786 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d581d expref: 29 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.683526:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a07786 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d581d expref: 29 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.683540:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342546944:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938782.683619:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747099479c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938782.687166:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342546944:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938782.687204:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0778d lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5824 expref: 29 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.687246:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700030a00, rc 0) 00000100:00100000:0.0:1784938782.687325:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:25037:x1871643326066432:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3935us (4126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.687333:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:1.0:1784938782.689845:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.689940:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326066560 00000100:00100000:0.0:1784938782.689950:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326066560 00010000:00010000:0.0:1784938782.689994:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a07786 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d581d expref: 29 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.690030:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:0.0:1784938782.690039:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10024:x1871643326066560:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938782.690054:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938782.690077:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a07786 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d581d expref: 29 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.690092:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a07786 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d581d expref: 29 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.690115:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005991e1c3/0xcd9d312a94a07786 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d581d expref: 29 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.690131:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.690149:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.690159:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0778d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5824 expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.690169:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0778d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5824 expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.690206:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0778d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5824 expref: 28 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.690234:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342547072:192.168.202.4@tcp:105: 00000100:00100000:0.0:1784938782.690336:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747099479c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784938782.691083:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07771 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.691095:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07771 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.691101:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07771 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.691119:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.691124:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07771 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.691131:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07771 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.691144:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd946e4d2 (ffff974703b59a00) 00010000:00010000:2.0:1784938782.691147:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.691151:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07771 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.691157:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07771 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd946e4d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.696544:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.696623:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326066816 00000100:00100000:3.0:1784938782.696632:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326066816 00000100:00100000:3.0:1784938782.696692:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:3.0:1784938782.696703:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+77:25037:x1871643326066816:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938782.697108:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+78:25037:x1871643326066816:12345-192.168.202.4@tcp:35:cp.0 Request processed in 406us (574us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1784938782.697117:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:0.0:1784938782.697258:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342547072:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938782.697291:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938782.697323:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:10024:x1871643326066560:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7285us (7487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.697332:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:0.0:1784938782.701871:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.702102:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326066944 00000100:00100000:1.0:1784938782.702112:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326066944 00000100:00100000:1.0:1784938782.702173:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:1.0:1784938782.702183:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+78:25037:x1871643326066944:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.702223:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.702257:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a07794 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d582b expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702527:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a0779b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702543:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a0779b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702556:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a0779b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702590:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702598:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702604:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702674:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a0779b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702683:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a0779b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702689:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a0779b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702696:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.702700:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a0779b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702707:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a0779b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702719:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.702723:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.702727:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a0779b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702733:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a0779b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702796:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702803:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702808:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702812:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.702815:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702821:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702829:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x7584afcd (ffff974707d24000) 00010000:00010000:1.0:1784938782.702832:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.702835:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702840:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702873:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a07794 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d582b expref: 79 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702882:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.702885:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.702895:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a07794 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d582b expref: 79 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.702905:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568c00, rc 0) 00000100:00100000:1.0:1784938782.703137:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+78:25037:x1871643326066944:12345-192.168.202.4@tcp:101:cp.0 Request processed in 954us (1272us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.703145:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:2.0:1784938782.707419:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.707514:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326067072 00000100:00100000:1.0:1784938782.707524:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326067072 00000100:00100000:1.0:1784938782.707623:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:1.0:1784938782.707633:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+78:25037:x1871643326067072:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.707651:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.707671:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a077a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5832 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.707732:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.707746:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.707867:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.707883:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a077b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.707890:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a077b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.707896:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a077b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708162:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708170:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708176:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708182:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.708187:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708194:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708206:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.708399:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.708407:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708414:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708428:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a077b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708433:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a077b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708438:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a077b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708450:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.708454:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a077b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708460:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a077b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708468:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x7584afcd (ffff974707d24e00) 00010000:00010000:1.0:1784938782.708471:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.708474:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a077b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708479:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a077b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708515:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a077a9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5832 expref: 79 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708525:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.708527:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.708531:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a077a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5832 expref: 79 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.708540:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569c00, rc 0) 00000100:00100000:1.0:1784938782.708656:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+78:25037:x1871643326067072:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1024us (1246us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.708665:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:2.0:1784938782.712405:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.712501:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326067328 00000100:00100000:1.0:1784938782.712521:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326067328 00000100:00100000:1.0:1784938782.712620:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:1.0:1784938782.712630:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+78:25037:x1871643326067328:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.712652:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.712672:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a077be lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5839 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.712843:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a077c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.712860:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a077c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.712871:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a077c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.712886:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x7584afcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.712893:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.712900:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938782.713726:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd:0x0], index 0: 0 00010000:00010000:1.0:1784938782.714160:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a077d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.714174:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a077d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.714195:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a077d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.714245:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a077c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.714254:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a077c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.714448:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a077c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.714455:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.714460:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a077c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.714468:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a077c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.714481:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.714484:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.714490:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a077c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.714496:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a077c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938782.714510:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e845b09 reply state 00000000583dfe8c transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.714519:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938782.714563:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a077be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5839 expref: 81 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.714578:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a077d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5839 expref: 80 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.714585:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff974707d24600) 00010000:00010000:1.0:1784938782.714588:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938782.714590:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569a00, rc 0) 00000100:00100000:1.0:1784938782.714718:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+81:25037:x1871643326067328:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2088us (2321us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1784938782.714727:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:0.0:1784938782.719849:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.720132:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326067456 00000100:00100000:1.0:1784938782.720141:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326067456 00000100:00100000:1.0:1784938782.720204:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:1.0:1784938782.720224:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:10025:x1871643326067456:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.720252:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.720285:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a077e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5840 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938782.720318:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938782.720339:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=936s v=(0 0) 00010000:00010000:1.0:1784938782.720343:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.720353:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a077e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5840 expref: 29 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.720370:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a077e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5840 expref: 29 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.720399:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569c00, rc 0) 00000100:00100000:1.0:1784938782.720465:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10025:x1871643326067456:12345-192.168.202.4@tcp:101:cp.0 Request processed in 243us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.720472:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 54 00010000:00010000:3.0:1784938782.721178:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.721190:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.721197:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.721203:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938782.721219:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.721227:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.721252:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x7584afcd (ffff974707d24000) 00010000:00010000:3.0:1784938782.721255:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938782.721260:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.721413:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a077cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x7584afcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.724982:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.725073:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326067584 00000100:00100000:0.0:1784938782.725084:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326067584 00000100:00100000:0.0:1784938782.725141:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:0.0:1784938782.725151:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:25037:x1871643326067584:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.725169:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.725189:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a077e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5847 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.725268:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a077e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5840 expref: 30 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.725278:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.725282:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.725287:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a077e8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5847 expref: 30 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.725328:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a077e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5840 expref: 30 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.725341:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a077e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5840 expref: 30 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.725355:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342547200:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938782.725435:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747099479c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938782.729050:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342547200:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938782.729087:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a077e8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5847 expref: 30 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.729107:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700031400, rc 0) 00000100:00100000:0.0:1784938782.729177:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:25037:x1871643326067584:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4026us (4204us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.729185:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:3.0:1784938782.731944:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.732046:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326067712 00000100:00100000:2.0:1784938782.732056:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326067712 00010000:00010000:2.0:1784938782.732100:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a077e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5840 expref: 30 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.732143:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:2.0:1784938782.732153:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:10026:x1871643326067712:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938782.732168:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938782.732191:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a077e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5840 expref: 30 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.732446:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a077e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5840 expref: 30 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.732470:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a077e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5840 expref: 30 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.732499:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938782.732503:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938782.732512:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a077e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5847 expref: 29 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.732522:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a077e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5847 expref: 29 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.732562:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a077e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5847 expref: 29 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.732576:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027ba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342547328:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938782.732693:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a8226c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.739097:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.739175:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326067968 00000100:00100000:0.0:1784938782.739185:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326067968 00000100:00100000:0.0:1784938782.739268:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:0.0:1784938782.739279:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+80:25037:x1871643326067968:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938782.739648:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+81:25037:x1871643326067968:12345-192.168.202.4@tcp:35:cp.0 Request processed in 370us (559us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1784938782.739656:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:3.0:1784938782.740499:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027ba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342547328:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938782.740523:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938782.740564:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10026:x1871643326067712:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8412us (8629us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.740575:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:2.0:1784938782.745867:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.746044:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326068096 00000100:00100000:1.0:1784938782.746054:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326068096 00000100:00100000:1.0:1784938782.746152:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:1.0:1784938782.746162:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+81:25037:x1871643326068096:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.746189:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.746219:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a077ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d584e expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746363:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746379:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746392:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746427:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a077fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746435:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a077fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746443:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a077fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746514:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746522:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746529:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746535:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.746539:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746547:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746559:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.746562:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.746567:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746573:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a077f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746584:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a077fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746591:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a077fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746597:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a077fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746607:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.746611:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a077fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746616:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a077fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746624:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xf4c8ca43 (ffff97473a027b00) 00010000:00010000:1.0:1784938782.746626:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.746629:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a077fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746636:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a077fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746667:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a077ef lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d584e expref: 82 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746677:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.746679:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.746683:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a077ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d584e expref: 82 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.746692:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569800, rc 0) 00000100:00100000:1.0:1784938782.746835:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+81:25037:x1871643326068096:12345-192.168.202.4@tcp:101:cp.0 Request processed in 673us (976us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.746841:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:2.0:1784938782.751000:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.751093:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326068224 00000100:00100000:1.0:1784938782.751119:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326068224 00000100:00100000:1.0:1784938782.751222:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00100000:1.0:1784938782.751234:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+81:25037:x1871643326068224:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.751271:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.751294:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07804 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5855 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751485:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0780b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751500:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0780b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751511:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0780b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751524:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07812 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751531:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751536:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751595:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0780b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751603:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0780b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751609:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0780b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751624:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.751629:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0780b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751637:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0780b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751649:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.751652:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.751656:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0780b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751662:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0780b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751675:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751681:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07812 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751687:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07812 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751692:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.751694:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07812 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751700:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07812 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751717:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xf4c8ca43 (ffff97473a027e00) 00010000:00010000:1.0:1784938782.751719:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.751722:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07812 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751728:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07812 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751789:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07804 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5855 expref: 82 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751798:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.751801:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.751805:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07804 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5855 expref: 82 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.751814:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569c00, rc 0) 00000100:00100000:1.0:1784938782.751876:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+81:25037:x1871643326068224:12345-192.168.202.4@tcp:101:cp.0 Request processed in 644us (884us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.751884:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00100000:2.0:1784938782.755678:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.755861:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326068480 00000100:00100000:1.0:1784938782.755872:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326068480 00000100:00100000:1.0:1784938782.755938:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:1.0:1784938782.755947:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+81:25037:x1871643326068480:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.755966:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.755989:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07819 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d585c expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.756134:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07820 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.756149:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07820 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.756159:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07820 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.756172:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07827 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.756179:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.756186:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938782.756893:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd:0x0], index 1: 0 00010000:00010000:1.0:1784938782.757064:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569000/0xcd9d312a94a0782e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.757076:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569000/0xcd9d312a94a0782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.757085:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569000/0xcd9d312a94a0782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.757135:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07820 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.757151:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07820 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.757157:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07820 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.757163:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.757167:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07820 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.757175:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07820 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.757187:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.757189:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.757194:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07820 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.757200:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07820 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938782.757608:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000048d177e reply state 00000000c9560e43 transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938782.757619:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938782.757651:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07819 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d585c expref: 84 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.757665:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569000/0xcd9d312a94a0782e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d585c expref: 83 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.757684:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff97473a027c00) 00010000:00010000:1.0:1784938782.757686:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938782.757689:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569000, rc 0) 00000100:00100000:1.0:1784938782.757814:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+84:25037:x1871643326068480:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1864us (2145us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1784938782.757825:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 91 00010000:00010000:1.0:1784938782.764653:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.764674:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07827 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.764681:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.764687:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.764692:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.764699:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07827 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.764716:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xf4c8ca43 (ffff97473a027000) 00010000:00010000:1.0:1784938782.764718:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.764722:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07827 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.764728:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07827 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xf4c8ca43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.768113:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.768466:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326068608 00000100:00100000:0.0:1784938782.768476:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326068608 00000100:00100000:0.0:1784938782.768533:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:0.0:1784938782.768543:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:10023:x1871643326068608:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.768561:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.768582:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c503ecd6/0xcd9d312a94a0783c lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5863 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938782.768610:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938782.768629:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=936s v=(0 0) 00010000:00010000:0.0:1784938782.768634:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.768643:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c503ecd6/0xcd9d312a94a0783c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5863 expref: 29 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.768660:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c503ecd6/0xcd9d312a94a0783c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5863 expref: 29 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.768674:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700030600, rc 0) 00000100:00100000:0.0:1784938782.768728:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10023:x1871643326068608:12345-192.168.202.4@tcp:101:cp.0 Request processed in 187us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.768741:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:2.0:1784938782.773115:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.773217:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326068736 00000100:00100000:0.0:1784938782.773228:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326068736 00000100:00100000:0.0:1784938782.773300:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:0.0:1784938782.773317:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:25037:x1871643326068736:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.773335:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.773354:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a07843 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d586a expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.773384:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c503ecd6/0xcd9d312a94a0783c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5863 expref: 30 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.773393:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.773397:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.773402:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a07843 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d586a expref: 30 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.773434:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c503ecd6/0xcd9d312a94a0783c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5863 expref: 30 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.773448:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c503ecd6/0xcd9d312a94a0783c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5863 expref: 30 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.773460:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342547456:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938782.773543:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747099479c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.776937:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.777017:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326068864 00000100:00100000:3.0:1784938782.777042:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326068864 00010000:00010000:3.0:1784938782.777083:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c503ecd6/0xcd9d312a94a0783c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5863 expref: 31 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.777128:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:3.0:1784938782.777138:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:10024:x1871643326068864:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938782.777152:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938782.777176:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c503ecd6/0xcd9d312a94a0783c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5863 expref: 31 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.777191:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c503ecd6/0xcd9d312a94a0783c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5863 expref: 31 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.777228:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.777233:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.777250:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a07843 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d586a expref: 31 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.777267:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a07843 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d586a expref: 31 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.777316:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a07843 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d586a expref: 31 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.777330:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342547584:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938782.777408:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318c00 going to sleep for 11 seconds 00010000:00010000:0.0:1784938782.778229:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c503ecd6/0xcd9d312a94a0783c lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5863 expref: 31 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.778402:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342547456:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938782.778428:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a07843 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d586a expref: 30 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.778439:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609396000, rc 0) 00000100:00100000:0.0:1784938782.778486:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:25037:x1871643326068736:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5177us (5382us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.778494:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:3.0:1784938782.782460:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342547584:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938782.782489:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938782.782546:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10024:x1871643326068864:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5407us (5617us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.782557:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:2.0:1784938782.790741:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.791024:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326069120 00000100:00100000:0.0:1784938782.791036:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326069120 00000100:00100000:0.0:1784938782.791132:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:0.0:1784938782.791143:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+83:25037:x1871643326069120:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938782.791541:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+84:25037:x1871643326069120:12345-192.168.202.4@tcp:35:cp.0 Request processed in 399us (810us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1784938782.791550:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:2.0:1784938782.795645:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.795738:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326069248 00000100:00100000:1.0:1784938782.795768:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326069248 00000100:00100000:1.0:1784938782.795829:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:1.0:1784938782.795839:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+84:25037:x1871643326069248:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.795863:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.795885:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a0784a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5871 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.795958:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07851 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.795974:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07851 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.795986:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07851 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796000:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07858 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796008:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796014:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796079:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07851 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796086:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07851 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796106:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07851 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796113:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.796118:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07851 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796126:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07851 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796139:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.796143:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.796147:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07851 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796153:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07851 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796167:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796172:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07858 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796178:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07858 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796183:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.796186:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07858 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796203:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07858 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796226:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x130bf32a (ffff97473a027000) 00010000:00010000:1.0:1784938782.796228:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.796231:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07858 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796284:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a07858 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796332:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a0784a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5871 expref: 85 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796342:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.796344:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.796347:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a0784a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5871 expref: 85 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.796356:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568600, rc 0) 00000100:00100000:1.0:1784938782.796428:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+84:25037:x1871643326069248:12345-192.168.202.4@tcp:101:cp.0 Request processed in 590us (794us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.796435:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:2.0:1784938782.801680:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.801811:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326069376 00000100:00100000:1.0:1784938782.801822:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326069376 00000100:00100000:1.0:1784938782.801886:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 93 00000100:00100000:1.0:1784938782.801896:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+84:25037:x1871643326069376:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.801942:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.801964:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a0785f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5878 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802048:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07866 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802064:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07866 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802074:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07866 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802089:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0786d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802096:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0786d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802103:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0786d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802175:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07866 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802182:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07866 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802188:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07866 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802194:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.802204:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07866 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802213:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07866 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802225:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.802228:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.802233:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07866 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802248:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07866 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802262:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0786d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802269:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0786d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802275:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0786d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802280:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.802283:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0786d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802290:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0786d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802297:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x130bf32a (ffff97473a027e00) 00010000:00010000:1.0:1784938782.802300:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.802318:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0786d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802324:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a0786d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802362:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a0785f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5878 expref: 85 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802373:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.802376:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.802380:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a0785f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5878 expref: 85 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.802390:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569c00, rc 0) 00000100:00100000:1.0:1784938782.802457:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+84:25037:x1871643326069376:12345-192.168.202.4@tcp:101:cp.0 Request processed in 562us (788us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.802464:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 93 00000100:00100000:2.0:1784938782.805862:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.805975:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326069632 00000100:00100000:0.0:1784938782.805986:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326069632 00000100:00100000:0.0:1784938782.806042:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 94 00000100:00100000:0.0:1784938782.806052:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+84:25037:x1871643326069632:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.806074:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.806097:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a07874 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d587f expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.806288:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a0787b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.806313:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a0787b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.806326:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a0787b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.806363:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07882 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x130bf32a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.806372:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07882 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.806379:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07882 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938782.806862:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe:0x0], index 0: 0 00010000:00010000:0.0:1784938782.807034:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251800/0xcd9d312a94a07889 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.807045:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251800/0xcd9d312a94a07889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.807052:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251800/0xcd9d312a94a07889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.807086:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a0787b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.807101:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a0787b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.807109:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a0787b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.807115:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938782.807119:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a0787b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.807126:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a0787b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.807154:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938782.807157:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938782.807162:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a0787b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.807169:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a0787b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938782.807184:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4b5df74 reply state 00000000c60997db transno 4294967348 ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07882 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.807193:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938782.807224:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a07874 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d587f expref: 87 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.807248:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251800/0xcd9d312a94a07889 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d587f expref: 86 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.807266:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff974705478300) 00010000:00010000:0.0:1784938782.807269:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938782.807271:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251800, rc 0) 00000100:00100000:0.0:1784938782.807354:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326069632:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1302us (1500us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1784938782.807362:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 94 00010000:00010000:2.0:1784938782.811506:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07882 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.811524:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07882 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.811532:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07882 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.811539:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.811543:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07882 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.811551:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07882 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.811568:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x130bf32a (ffff974705478c00) 00010000:00010000:2.0:1784938782.811571:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.811575:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07882 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.811582:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07882 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x130bf32a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.816644:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.816890:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326069760 00000100:00100000:1.0:1784938782.816900:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326069760 00000100:00100000:1.0:1784938782.816956:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:1.0:1784938782.816966:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10025:x1871643326069760:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.816985:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.817008:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a07897 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5886 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938782.817035:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938782.817056:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=936s v=(0 0) 00010000:00010000:1.0:1784938782.817068:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.817077:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a07897 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5886 expref: 30 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.817094:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a07897 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5886 expref: 30 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.817107:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569c00, rc 0) 00000100:00100000:1.0:1784938782.817162:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:10025:x1871643326069760:12345-192.168.202.4@tcp:101:cp.0 Request processed in 197us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.817168:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:2.0:1784938782.820841:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.820917:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326069888 00000100:00100000:0.0:1784938782.820926:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326069888 00000100:00100000:0.0:1784938782.820973:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:0.0:1784938782.820983:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:25037:x1871643326069888:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.821002:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.821020:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055f6d12b/0xcd9d312a94a0789e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d588d expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.821051:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a07897 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5886 expref: 31 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.821062:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.821066:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.821072:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055f6d12b/0xcd9d312a94a0789e lrc: 4/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d588d expref: 31 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.821103:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a07897 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5886 expref: 31 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.821139:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a07897 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5886 expref: 31 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.821152:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342547712:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938782.821246:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.830422:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.830561:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342547712:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938782.830597:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055f6d12b/0xcd9d312a94a0789e lrc: 3/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d588d expref: 31 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.830620:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251c00, rc 0) 00000100:00100000:0.0:1784938782.830696:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:25037:x1871643326069888:12345-192.168.202.4@tcp:101:cp.0 Request processed in 9701us (9853us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.830706:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:3.0:1784938782.830793:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326070016 00000100:00100000:3.0:1784938782.830800:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326070016 00010000:00010000:3.0:1784938782.830831:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a07897 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5886 expref: 31 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.830860:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:3.0:1784938782.830868:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:10025:x1871643326070016:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938782.830882:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938782.830902:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a07897 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5886 expref: 31 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.830926:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a07897 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5886 expref: 31 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.830946:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cf41fdd/0xcd9d312a94a07897 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5886 expref: 31 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.830960:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.830964:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.830972:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055f6d12b/0xcd9d312a94a0789e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d588d expref: 30 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.830999:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055f6d12b/0xcd9d312a94a0789e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d588d expref: 30 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.831030:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000055f6d12b/0xcd9d312a94a0789e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d588d expref: 30 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.831044:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342547840:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938782.831092:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974717fb5780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938782.837728:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342547840:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938782.837967:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938782.838061:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:10025:x1871643326070016:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7191us (7647us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.838073:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:2.0:1784938782.839405:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.841197:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326070272 00000100:00100000:1.0:1784938782.841209:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326070272 00000100:00100000:1.0:1784938782.841280:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:1.0:1784938782.841291:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+86:25037:x1871643326070272:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:1.0:1784938782.841629:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326070272:12345-192.168.202.4@tcp:35:cp.0 Request processed in 338us (2230us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1784938782.841637:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:3.0:1784938782.846952:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.847122:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326070400 00000100:00100000:2.0:1784938782.847133:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326070400 00000100:00100000:2.0:1784938782.847196:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 95 00000100:00100000:2.0:1784938782.847206:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326070400:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938782.847229:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938782.847269:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a078a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5894 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847490:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847508:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847520:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847560:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a078b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847568:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a078b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847575:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a078b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847641:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847666:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847673:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847680:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.847684:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847693:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847706:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.847709:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.847713:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847719:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847731:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a078b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847737:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a078b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847742:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a078b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847747:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.847800:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a078b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847808:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a078b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847816:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe00215d9 (ffff974710f9bc00) 00010000:00010000:2.0:1784938782.847819:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.847822:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a078b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847829:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a078b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847866:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a078a5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5894 expref: 88 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847877:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.847879:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.847883:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a078a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5894 expref: 88 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.847892:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924e000, rc 0) 00000100:00100000:2.0:1784938782.848128:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326070400:12345-192.168.202.4@tcp:101:cp.0 Request processed in 922us (1186us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938782.848137:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 95 00000100:00100000:2.0:1784938782.851610:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.851701:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326070528 00000100:00100000:1.0:1784938782.851710:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326070528 00000100:00100000:1.0:1784938782.851805:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 96 00000100:00100000:1.0:1784938782.851815:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326070528:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.851838:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.851859:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a078ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d589b expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.851965:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a078c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.851981:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a078c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.851992:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a078c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852006:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a078c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852011:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a078c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852017:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a078c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852084:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a078c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852091:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a078c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852098:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a078c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852104:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.852108:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a078c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852127:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a078c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852140:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.852143:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.852148:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a078c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852154:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a078c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852169:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a078c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852174:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a078c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852179:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a078c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852185:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.852187:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a078c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852193:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a078c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852200:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe00215d9 (ffff97473a027b00) 00010000:00010000:1.0:1784938782.852202:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.852205:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a078c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852222:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568400/0xcd9d312a94a078c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852268:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a078ba lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d589b expref: 88 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852279:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.852280:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.852284:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a078ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d589b expref: 88 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.852292:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569600, rc 0) 00000100:00100000:1.0:1784938782.852492:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326070528:12345-192.168.202.4@tcp:101:cp.0 Request processed in 678us (891us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.852500:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 96 00000100:00100000:1.0:1784938782.856636:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.856715:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326070784 00000100:00100000:2.0:1784938782.856727:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326070784 00000100:00100000:2.0:1784938782.856821:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00100000:2.0:1784938782.856844:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326070784:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938782.856864:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938782.856884:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a078cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58a2 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857020:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a078d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857035:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a078d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857046:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a078d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857061:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857069:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857076:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938782.857549:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe:0x0], index 1: 0 00010000:00010000:2.0:1784938782.857724:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a078e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857734:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a078e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857743:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a078e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857811:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a078d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857818:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a078d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857825:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a078d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857831:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.857836:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a078d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857843:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a078d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857854:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.857857:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.857862:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a078d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857868:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a078d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938782.857881:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb82b5aa reply state 000000000bf3fa4f transno 4294967350 ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.857889:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938782.857918:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a078cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58a2 expref: 90 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857942:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a078e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58a2 expref: 89 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.857950:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1c:0x0].0x0 (ffff974710f9b100) 00010000:00010000:2.0:1784938782.857953:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938782.857955:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148ba00, rc 0) 00000100:00100000:2.0:1784938782.858502:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326070784:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1657us (1874us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1784938782.858511:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00100000:0.0:1784938782.863786:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1784938782.863896:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.864170:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.864178:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.864184:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.864188:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.864212:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.864231:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe00215d9 (ffff974710f9bb00) 00010000:00010000:1.0:1784938782.864234:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.864247:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.864254:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a078dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe00215d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.864388:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326070912 00000100:00100000:3.0:1784938782.864399:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326070912 00000100:00100000:3.0:1784938782.864482:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:3.0:1784938782.864492:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10023:x1871643326070912:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.864509:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.864527:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a078f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58a9 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938782.864553:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938782.864570:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1784938782.864581:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.864590:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a078f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58a9 expref: 30 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.864607:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a078f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58a9 expref: 30 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.864618:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209b600, rc 0) 00000100:00100000:3.0:1784938782.864679:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:10023:x1871643326070912:12345-192.168.202.4@tcp:101:cp.0 Request processed in 189us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.864687:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:2.0:1784938782.868626:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.868800:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326071040 00000100:00100000:0.0:1784938782.868811:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326071040 00000100:00100000:0.0:1784938782.868870:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:0.0:1784938782.868880:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:25037:x1871643326071040:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.868898:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.868927:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b10ee71a/0xcd9d312a94a078f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58b0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.868957:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a078f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58a9 expref: 31 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.868987:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.868992:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.868998:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b10ee71a/0xcd9d312a94a078f9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->57343] (req 0->57343) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58b0 expref: 31 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.869031:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a078f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58a9 expref: 31 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.869045:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a078f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58a9 expref: 31 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.869058:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342547968:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938782.869135:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.872270:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.872319:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342547968:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938782.872350:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b10ee71a/0xcd9d312a94a078f9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->57343] (req 0->57343) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58b0 expref: 31 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.872372:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250200, rc 0) 00000100:00100000:1.0:1784938782.872437:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:25037:x1871643326071040:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3558us (3820us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938782.872446:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:3.0:1784938782.872644:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326071168 00000100:00100000:3.0:1784938782.872652:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326071168 00010000:00010000:3.0:1784938782.872721:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a078f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58a9 expref: 31 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.872795:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:3.0:1784938782.872803:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:10023:x1871643326071168:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938782.872880:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938782.872917:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a078f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58a9 expref: 31 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.872932:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a078f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58a9 expref: 31 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.872952:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a078f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58a9 expref: 31 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.872967:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938782.872971:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938782.872979:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b10ee71a/0xcd9d312a94a078f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58b0 expref: 30 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.873011:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b10ee71a/0xcd9d312a94a078f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58b0 expref: 30 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.873045:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b10ee71a/0xcd9d312a94a078f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58b0 expref: 30 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.873057:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602693b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342548096:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938782.873120:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a8223c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.879292:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.880522:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602693b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342548096:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938782.880550:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938782.880614:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:10023:x1871643326071168:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7810us (8358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.880625:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:1.0:1784938782.885425:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326071424 00000100:00100000:1.0:1784938782.885439:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326071424 00000100:00100000:1.0:1784938782.885551:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:1.0:1784938782.885563:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+89:25037:x1871643326071424:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:1.0:1784938782.885959:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326071424:12345-192.168.202.4@tcp:35:cp.0 Request processed in 397us (6676us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1784938782.885967:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:2.0:1784938782.889652:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.889736:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326071552 00000100:00100000:0.0:1784938782.890071:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326071552 00000100:00100000:2.0:1784938782.890299:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 98 00000100:00100000:2.0:1784938782.890313:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326071552:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938782.890337:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938782.890359:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07900 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58b7 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890427:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07907 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890442:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07907 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890453:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07907 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890468:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a0790e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890489:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a0790e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890497:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a0790e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890565:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07907 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890572:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07907 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890578:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07907 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890585:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148b200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.890589:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07907 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890596:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07907 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890609:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.890612:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.890618:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07907 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890625:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a07907 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.890998:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a0790e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.891014:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a0790e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.891019:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a0790e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.891024:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.891027:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a0790e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.891032:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a0790e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.891040:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x868dff87 (ffff974710f9bc00) 00010000:00010000:2.0:1784938782.891043:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.891046:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a0790e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.891051:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a0790e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.891090:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07900 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58b7 expref: 91 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.891100:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.891102:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.891105:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07900 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58b7 expref: 91 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.891126:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148a800, rc 0) 00000100:00100000:2.0:1784938782.891198:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326071552:12345-192.168.202.4@tcp:101:cp.0 Request processed in 889us (1556us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938782.891205:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 98 00000100:00100000:3.0:1784938782.896399:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.896668:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326071680 00000100:00100000:2.0:1784938782.896679:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326071680 00000100:00100000:2.0:1784938782.896764:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 99 00000100:00100000:3.0:1784938782.896773:0:30631:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784938782.896777:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326071680:12345-192.168.202.4@tcp:101:cp.0 00000100:00100000:3.0:1784938782.896783:0:30631:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00010000:2.0:1784938782.896798:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938782.896820:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07915 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58be expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.896890:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0791c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.896905:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0791c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.896916:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0791c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.896930:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07923 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.896936:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.896942:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897017:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0791c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897023:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0791c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897028:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0791c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897034:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.897038:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0791c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897044:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0791c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897056:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.897059:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.897064:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0791c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897071:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a0791c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897084:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897089:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07923 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897094:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897105:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.897109:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897115:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897124:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x868dff87 (ffff974710f9bb00) 00010000:00010000:2.0:1784938782.897126:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.897129:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07923 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897134:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07923 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897169:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07915 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58be expref: 91 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897178:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.897180:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.897183:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07915 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58be expref: 91 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.897191:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924e000, rc 0) 00000100:00100000:2.0:1784938782.897266:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326071680:12345-192.168.202.4@tcp:101:cp.0 Request processed in 492us (878us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938782.897273:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 99 00000100:00100000:0.0:1784938782.904697:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938782.905050:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326071936 00000100:00100000:2.0:1784938782.905068:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326071936 00000100:00100000:2.0:1784938782.905148:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 100 00000100:00100000:2.0:1784938782.905156:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326071936:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938782.905173:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938782.905190:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0792a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58c5 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.905337:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07931 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.905352:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07931 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.905363:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07931 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.905378:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07938 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x868dff87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.905384:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.905388:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938782.905785:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf:0x0], index 0: 0 00010000:00010000:2.0:1784938782.906000:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0793f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.906008:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0793f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.906023:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0793f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.906050:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07931 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.906055:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07931 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.906060:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07931 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.906063:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.906066:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07931 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.906071:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07931 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.906079:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.906081:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.906084:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07931 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.906089:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07931 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938782.906098:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a4d17b4 reply state 00000000a692d0fd transno 4294967352 ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.906103:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938782.906130:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0792a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58c5 expref: 93 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.906139:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0793f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58c5 expref: 92 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.906144:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff97473635e000) 00010000:00010000:2.0:1784938782.906145:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938782.906147:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97470148b200, rc 0) 00000100:00100000:2.0:1784938782.906203:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+93:25037:x1871643326071936:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1048us (1516us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1784938782.906210:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 100 00010000:00010000:2.0:1784938782.913697:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.913718:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07938 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.913726:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07938 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.913732:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.913737:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07938 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.913776:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07938 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.913795:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x868dff87 (ffff974710f9bc00) 00010000:00010000:2.0:1784938782.913798:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.913822:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07938 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.913829:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07938 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x868dff87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.915258:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.915407:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326072064 00000100:00100000:3.0:1784938782.915418:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326072064 00000100:00100000:3.0:1784938782.915513:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:3.0:1784938782.915525:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:10026:x1871643326072064:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.915551:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.915578:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a0794d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58cc expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938782.915609:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938782.915628:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1784938782.915632:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.915643:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a0794d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58cc expref: 31 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.915661:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a0794d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58cc expref: 31 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.915675:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209aa00, rc 0) 00000100:00100000:3.0:1784938782.916040:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:10026:x1871643326072064:12345-192.168.202.4@tcp:101:cp.0 Request processed in 217us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.916049:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:3.0:1784938782.922929:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.923098:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326072192 00000100:00100000:1.0:1784938782.923106:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326072192 00000100:00100000:1.0:1784938782.923159:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:1.0:1784938782.923166:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:25037:x1871643326072192:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.923183:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.923199:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf6ac6c8/0xcd9d312a94a07954 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58d3 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.924544:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a0794d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58cc expref: 32 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.924561:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.924566:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938782.924572:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf6ac6c8/0xcd9d312a94a07954 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58d3 expref: 32 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.924674:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a0794d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58cc expref: 32 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.924695:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a0794d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58cc expref: 32 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.924712:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602693800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342548224:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938782.924843:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a8226c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.929059:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.929144:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326072320 00000100:00100000:3.0:1784938782.929153:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326072320 00010000:00010000:3.0:1784938782.929254:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a0794d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58cc expref: 33 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.929319:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:3.0:1784938782.929329:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:10025:x1871643326072320:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938782.929345:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938782.929367:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a0794d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58cc expref: 33 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.929382:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a0794d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58cc expref: 33 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.929409:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.929413:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.929422:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf6ac6c8/0xcd9d312a94a07954 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58d3 expref: 33 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.929432:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf6ac6c8/0xcd9d312a94a07954 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58d3 expref: 33 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.929472:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cf6ac6c8/0xcd9d312a94a07954 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58d3 expref: 33 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938782.929487:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342548352:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938782.929570:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026db780 going to sleep for 11 seconds 00010000:00010000:0.0:1784938782.930603:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051cbfa21/0xcd9d312a94a0794d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58cc expref: 33 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.930621:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602693800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342548224:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938782.930645:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf6ac6c8/0xcd9d312a94a07954 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58d3 expref: 32 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.930675:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568400, rc 0) 00000100:00100000:0.0:1784938782.930825:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:25037:x1871643326072192:12345-192.168.202.4@tcp:101:cp.0 Request processed in 7657us (7904us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.930833:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:3.0:1784938782.933143:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342548352:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938782.933182:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938782.933395:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:10025:x1871643326072320:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4065us (4344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.933407:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:2.0:1784938782.936037:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.937368:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326072576 00000100:00100000:0.0:1784938782.937381:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326072576 00000100:00100000:0.0:1784938782.937436:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:0.0:1784938782.937446:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705cda050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+92:25037:x1871643326072576:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938782.938202:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705cda050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+93:25037:x1871643326072576:12345-192.168.202.4@tcp:35:cp.0 Request processed in 755us (2172us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1784938782.938211:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:2.0:1784938782.944087:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.944257:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326072704 00000100:00100000:1.0:1784938782.944267:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326072704 00000100:00100000:1.0:1784938782.944442:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 101 00000100:00100000:1.0:1784938782.944454:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+93:25037:x1871643326072704:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.944480:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.944501:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a0795b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58da expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944572:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07962 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944587:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07962 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944613:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07962 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944627:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07969 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944634:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944641:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944702:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07962 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944708:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07962 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944714:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07962 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944720:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.944724:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07962 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944731:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07962 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944786:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.944790:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.944795:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07962 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944806:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07962 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944819:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944825:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07969 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944831:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07969 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944836:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.944839:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07969 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944845:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07969 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944852:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x39c3d8fe (ffff97473a027b00) 00010000:00010000:1.0:1784938782.944854:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.944856:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07969 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944861:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07969 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944898:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a0795b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58da expref: 94 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944919:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.944921:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.944925:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a0795b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58da expref: 94 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.944935:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568600, rc 0) 00000100:00100000:1.0:1784938782.944992:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+93:25037:x1871643326072704:12345-192.168.202.4@tcp:101:cp.0 Request processed in 541us (913us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.944999:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 101 00000100:00100000:2.0:1784938782.954208:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.954289:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326072832 00000100:00100000:1.0:1784938782.954310:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326072832 00000100:00100000:1.0:1784938782.954371:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 102 00000100:00100000:1.0:1784938782.954381:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+93:25037:x1871643326072832:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.954402:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.954424:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07970 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58e1 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954489:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07977 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954503:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07977 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954516:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07977 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954530:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0797e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954549:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0797e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954556:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0797e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954621:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07977 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954629:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07977 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954636:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07977 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954642:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.954646:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07977 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954654:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07977 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954666:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.954669:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.954674:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07977 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954680:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07977 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954693:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0797e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954706:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0797e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954711:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0797e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954715:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.954719:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0797e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954724:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0797e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954732:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x39c3d8fe (ffff97473a027d00) 00010000:00010000:1.0:1784938782.954735:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.954748:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0797e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954802:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0797e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954827:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07970 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58e1 expref: 94 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954834:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.954836:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.954838:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07970 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58e1 expref: 94 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.954852:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569e00, rc 0) 00000100:00100000:1.0:1784938782.954904:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+93:25037:x1871643326072832:12345-192.168.202.4@tcp:101:cp.0 Request processed in 526us (704us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938782.954912:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 102 00000100:00100000:2.0:1784938782.958115:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.958204:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326073088 00000100:00100000:3.0:1784938782.958216:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326073088 00000100:00100000:3.0:1784938782.958294:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 103 00000100:00100000:3.0:1784938782.958305:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+93:25037:x1871643326073088:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.958326:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.958348:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07985 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58e8 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.958478:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b400/0xcd9d312a94a0798c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.958492:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b400/0xcd9d312a94a0798c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.958510:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b400/0xcd9d312a94a0798c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.958526:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07993 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.958533:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.958540:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938782.962393:0:33061:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf:0x0], index 1: 0 00010000:00010000:2.0:1784938782.962574:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04000/0xcd9d312a94a0799a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.962590:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04000/0xcd9d312a94a0799a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.962602:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04000/0xcd9d312a94a0799a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.962638:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b400/0xcd9d312a94a0798c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.962648:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b400/0xcd9d312a94a0798c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.962653:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b400/0xcd9d312a94a0798c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.962656:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209b400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938782.962660:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b400/0xcd9d312a94a0798c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.962665:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b400/0xcd9d312a94a0798c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.962675:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938782.962676:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938782.962680:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b400/0xcd9d312a94a0798c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.962684:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b400/0xcd9d312a94a0798c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938782.962696:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cc0ef27a reply state 000000004621bcd5 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.962705:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938782.962745:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07985 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58e8 expref: 96 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.963068:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04000/0xcd9d312a94a0799a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58e8 expref: 95 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938782.963088:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff974710f9bc00) 00010000:00010000:2.0:1784938782.963090:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938782.963093:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04000, rc 0) 00000100:00100000:2.0:1784938782.963174:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+96:25037:x1871643326073088:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4871us (5072us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1784938782.963181:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 103 00010000:00010000:1.0:1784938782.967642:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.967660:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07993 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.967667:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.967673:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.967677:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.967685:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07993 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.967703:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x39c3d8fe (ffff974707d24000) 00010000:00010000:1.0:1784938782.967706:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.967711:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07993 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.967717:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07993 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x39c3d8fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938782.969628:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938782.969983:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326073216 00000100:00100000:3.0:1784938782.969992:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326073216 00000100:00100000:3.0:1784938782.970039:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:3.0:1784938782.970046:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:10023:x1871643326073216:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938782.970061:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938782.970079:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3c198e5/0xcd9d312a94a079a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58ef expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938782.970101:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938782.970116:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1784938782.970119:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938782.970126:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3c198e5/0xcd9d312a94a079a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58ef expref: 31 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.970138:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a3c198e5/0xcd9d312a94a079a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58ef expref: 31 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938782.970146:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209bc00, rc 0) 00000100:00100000:3.0:1784938782.970196:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:10023:x1871643326073216:12345-192.168.202.4@tcp:101:cp.0 Request processed in 150us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938782.970201:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:3.0:1784938782.973223:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.973387:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326073344 00000100:00100000:0.0:1784938782.973395:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326073344 00000100:00100000:0.0:1784938782.973478:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:0.0:1784938782.973486:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:25037:x1871643326073344:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938782.973500:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938782.973520:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bacfa4a0/0xcd9d312a94a079af lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58f6 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.973550:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3c198e5/0xcd9d312a94a079a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58ef expref: 32 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.973560:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.973564:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.973585:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bacfa4a0/0xcd9d312a94a079af lrc: 4/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58f6 expref: 32 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.973620:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3c198e5/0xcd9d312a94a079a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58ef expref: 32 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.973633:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3c198e5/0xcd9d312a94a079a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58ef expref: 32 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.973643:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f605f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342548480:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938782.973713:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938782.977515:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f605f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342548480:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938782.977556:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bacfa4a0/0xcd9d312a94a079af lrc: 3/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58f6 expref: 32 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.977581:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250c00, rc 0) 00000100:00100000:0.0:1784938782.977679:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:25037:x1871643326073344:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4192us (4471us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.977689:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:3.0:1784938782.980019:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.980410:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326073472 00000100:00100000:0.0:1784938782.980421:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326073472 00010000:00010000:0.0:1784938782.980461:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3c198e5/0xcd9d312a94a079a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58ef expref: 32 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.980506:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:0.0:1784938782.980515:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:10024:x1871643326073472:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938782.980544:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938782.980570:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3c198e5/0xcd9d312a94a079a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58ef expref: 32 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.980584:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3c198e5/0xcd9d312a94a079a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58ef expref: 32 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.980608:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3c198e5/0xcd9d312a94a079a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58ef expref: 32 pid: 31425 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.980626:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.980631:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938782.980640:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bacfa4a0/0xcd9d312a94a079af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58f6 expref: 31 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.980650:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bacfa4a0/0xcd9d312a94a079af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58f6 expref: 31 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938782.980685:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bacfa4a0/0xcd9d312a94a079af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58f6 expref: 31 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938782.980700:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f605f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342548608:192.168.202.4@tcp:105: 00000100:00100000:0.0:1784938782.980827:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938782.989477:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938782.989641:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f605f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342548608:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938782.989667:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938782.989770:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:10024:x1871643326073472:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9236us (9738us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938782.989784:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:1.0:1784938782.990216:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326073728 00000100:00100000:1.0:1784938782.990231:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326073728 00000100:00100000:1.0:1784938782.990291:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:1.0:1784938782.990300:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+95:25037:x1871643326073728:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:1.0:1784938782.990636:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+96:25037:x1871643326073728:12345-192.168.202.4@tcp:35:cp.0 Request processed in 336us (1171us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1784938782.990643:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:2.0:1784938782.995918:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938782.996130:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326073856 00000100:00100000:1.0:1784938782.996139:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326073856 00000100:00100000:1.0:1784938782.996195:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 104 00000100:00100000:1.0:1784938782.996203:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+96:25037:x1871643326073856:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938782.996230:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938782.996267:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a079b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d58fd expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996396:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a079bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996411:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a079bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996421:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a079bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996434:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a079c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996444:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a079c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996449:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a079c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996528:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a079bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996535:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a079bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996542:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a079bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996548:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.996553:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a079bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996561:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a079bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996573:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.996576:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.996580:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a079bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996585:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a079bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996598:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a079c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996604:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a079c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996611:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a079c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996622:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938782.996625:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a079c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996635:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a079c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996643:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x5b30f298 (ffff97473a027d00) 00010000:00010000:1.0:1784938782.996646:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.996648:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a079c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996654:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a079c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996684:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a079b6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58fd expref: 97 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996693:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938782.996695:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938782.996698:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a079b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58fd expref: 97 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938782.996707:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569e00, rc 0) 00000100:00100000:0.0:1784938782.998287:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+96:25037:x1871643326073856:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2076us (2370us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938782.998360:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 104 00000100:00100000:2.0:1784938783.003184:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.003287:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326073984 00000100:00100000:1.0:1784938783.003297:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326073984 00000100:00100000:1.0:1784938783.003367:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 105 00000100:00100000:1.0:1784938783.003378:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+96:25037:x1871643326073984:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.003417:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.003440:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a079cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5904 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003503:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a079d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003519:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a079d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003530:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a079d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003544:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a079d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003551:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a079d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003556:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a079d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003617:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a079d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003625:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a079d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003631:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a079d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003636:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.003645:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a079d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003652:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a079d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003665:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.003667:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.003672:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a079d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003678:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a079d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003690:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a079d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003695:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a079d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003699:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a079d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003704:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.003707:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a079d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003712:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a079d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003719:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x5b30f298 (ffff97473a027b00) 00010000:00010000:1.0:1784938783.003721:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.003733:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a079d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003739:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a079d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003816:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a079cb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5904 expref: 97 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003826:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.003829:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.003831:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a079cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5904 expref: 97 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.003840:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569800, rc 0) 00000100:00100000:1.0:1784938783.003974:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+96:25037:x1871643326073984:12345-192.168.202.4@tcp:101:cp.0 Request processed in 597us (803us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938783.003981:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 105 00000100:00100000:1.0:1784938783.008840:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.008936:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326074240 00000100:00100000:2.0:1784938783.008948:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326074240 00000100:00100000:2.0:1784938783.009021:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 106 00000100:00100000:2.0:1784938783.009032:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+96:25037:x1871643326074240:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938783.009052:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938783.009073:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a079e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d590b expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.009203:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a079e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.009226:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a079e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.009247:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a079e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.009281:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a079ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.009289:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a079ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.009295:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a079ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938783.009813:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10:0x0], index 0: 0 00010000:00010000:2.0:1784938783.009960:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04a00/0xcd9d312a94a079f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.009971:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04a00/0xcd9d312a94a079f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.009979:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04a00/0xcd9d312a94a079f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.010014:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a079e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.010022:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a079e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.010028:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a079e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.010034:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.010038:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a079e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.010055:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a079e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.010067:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.010070:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.010074:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a079e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.010080:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a079e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938783.010091:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000030d30e86 reply state 0000000027c4a1f7 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a079ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.010099:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938783.010126:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a079e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d590b expref: 99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.010136:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04a00/0xcd9d312a94a079f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d590b expref: 98 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.010141:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff97473e984400) 00010000:00010000:2.0:1784938783.010143:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938783.010144:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04a00, rc 0) 00000100:00100000:2.0:1784938783.010204:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+99:25037:x1871643326074240:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1174us (1375us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1784938783.010213:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 106 00010000:00010000:2.0:1784938783.014853:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a079ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.014900:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a079ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.014908:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a079ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.014914:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.014919:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a079ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.014928:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a079ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.014946:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x5b30f298 (ffff974710f9bb00) 00010000:00010000:2.0:1784938783.014949:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.014954:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a079ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.014960:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a079ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5b30f298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.018793:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.018900:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326074368 00000100:00100000:3.0:1784938783.018909:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326074368 00000100:00100000:3.0:1784938783.018997:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:3.0:1784938783.019007:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:10026:x1871643326074368:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.019026:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.019048:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a07a03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5912 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938783.019078:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938783.019100:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=936s v=(0 0) 00010000:00010000:3.0:1784938783.019104:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.019114:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a07a03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5912 expref: 32 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.019132:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a07a03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5912 expref: 32 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.019146:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209a000, rc 0) 00000100:00100000:3.0:1784938783.019208:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:10026:x1871643326074368:12345-192.168.202.4@tcp:101:cp.0 Request processed in 201us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938783.019224:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00080000:1.0:1784938783.019291:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938783.024881:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.025021:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326074496 00000100:00100000:0.0:1784938783.025031:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326074496 00000100:00100000:0.0:1784938783.025093:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:0.0:1784938783.025103:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:25037:x1871643326074496:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.025122:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.025141:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9558ab1/0xcd9d312a94a07a0a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5919 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.025175:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a07a03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5912 expref: 33 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.025184:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.025189:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.025194:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9558ab1/0xcd9d312a94a07a0a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5919 expref: 33 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.025243:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a07a03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5912 expref: 33 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.025258:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a07a03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5912 expref: 33 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938783.025295:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f605f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342548736:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938783.027072:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9480 going to sleep for 11 seconds 00010000:00010000:1.0:1784938783.028085:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938783.030058:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.030166:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326074624 00000100:00100000:3.0:1784938783.030175:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326074624 00010000:00010000:3.0:1784938783.030215:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a07a03 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5912 expref: 34 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.030276:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:3.0:1784938783.030286:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+34:10026:x1871643326074624:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938783.030324:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938783.030349:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a07a03 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5912 expref: 34 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.030364:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a07a03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5912 expref: 34 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.030388:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.030393:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.030402:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9558ab1/0xcd9d312a94a07a0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5919 expref: 34 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.030412:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9558ab1/0xcd9d312a94a07a0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5919 expref: 34 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.030448:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f9558ab1/0xcd9d312a94a07a0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5919 expref: 34 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.030462:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342548864:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938783.030542:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026dbc00 going to sleep for 11 seconds 00010000:00010000:0.0:1784938783.030938:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a07a03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5912 expref: 34 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938783.030954:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f605f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342548736:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938783.030979:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9558ab1/0xcd9d312a94a07a0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5919 expref: 33 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.030989:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250400, rc 0) 00000100:00100000:0.0:1784938783.031031:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:25037:x1871643326074496:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5929us (6161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938783.031039:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:3.0:1784938783.035864:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342548864:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938783.035902:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938783.035960:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:10026:x1871643326074624:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5674us (5910us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938783.035972:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:2.0:1784938783.036914:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.036999:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326074752 00000100:00100000:1.0:1784938783.037007:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326074752 00002000:00100000:1.0:1784938783.037055:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x8:0x0] (0->28244) req@ffff974707fb0000 x1871643326074752/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 488/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938783.037066:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb0000 with x1871643326074752 ext(0->28244) 00002000:00010000:1.0:1784938783.037072:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb0000 00000100:00100000:1.0:1784938783.037102:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:1.0:1784938783.037121:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:10024:x1871643326074752:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938783.037679:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.037839:0:31431:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784938783.037848:0:31431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1784938783.039720:0:31431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326074880 00000100:00100000:0.0:1784938783.039732:0:31431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326074880 00002000:00100000:0.0:1784938783.039805:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x9:0x0] (0->1753) req@ffff97472a1ec380 x1871643326074880/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 2248/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938783.039816:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1ec380 with x1871643326074880 ext(0->1753) 00002000:00010000:0.0:1784938783.039822:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97472a1ec380 00000100:00100000:2.0:1784938783.043082:0:33062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:2.0:1784938783.043097:0:33062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+34:10024:x1871643326074880:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938783.044315:0:33062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:10024:x1871643326074880:12345-192.168.202.4@tcp:4:cp.0 Request processed in 1215us (6632us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784938783.044336:0:33062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00002000:00100000:2.0:1784938783.044348:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x9:0x0] (0->1753) req@ffff97472a1ec380 x1871643326074880/t4294967308(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 2248/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.044358:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1ec380 with x1871643326074880 ext(0->1753) 00002000:00010000:2.0:1784938783.044364:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97472a1ec380 00000100:00100000:2.0:1784938783.044813:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.044950:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.044969:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.044986:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.044997:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.045010:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.045099:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326075264 00000100:00100000:2.0:1784938783.045107:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326075264 00002000:00100000:2.0:1784938783.045141:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc:0x0] (0->18268) req@ffff974707fb0e00 x1871643326075264/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 488/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.045150:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb0e00 with x1871643326075264 ext(0->18268) 00002000:00010000:2.0:1784938783.045154:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb0e00 00000100:00100000:2.0:1784938783.045166:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326075008 00000100:00100000:2.0:1784938783.045168:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326075008 00002000:00100000:2.0:1784938783.045180:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xa:0x0] (0->1612) req@ffff974707fb1880 x1871643326075008/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 2104/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.045187:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb1880 with x1871643326075008 ext(0->1612) 00002000:00010000:2.0:1784938783.045190:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb1880 00000100:00100000:2.0:1784938783.045195:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326075136 00000100:00100000:2.0:1784938783.045197:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326075136 00002000:00100000:2.0:1784938783.045218:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xb:0x0] (0->837) req@ffff974707fb0a80 x1871643326075136/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 1328/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.045226:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb0a80 with x1871643326075136 ext(0->837) 00002000:00010000:2.0:1784938783.045230:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb0a80 00000100:00100000:2.0:1784938783.045248:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326075392 00000100:00100000:2.0:1784938783.045252:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326075392 00002000:00100000:2.0:1784938783.045267:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xd:0x0] (0->3005) req@ffff974707fb1f80 x1871643326075392/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 3496/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.045274:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb1f80 with x1871643326075392 ext(0->3005) 00002000:00010000:2.0:1784938783.045278:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb1f80 00000100:00100000:2.0:1784938783.045288:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326075520 00000100:00100000:2.0:1784938783.045290:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326075520 00002000:00100000:2.0:1784938783.045302:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xe:0x0] (0->937) req@ffff974707fb0380 x1871643326075520/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 1432/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.045309:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb0380 with x1871643326075520 ext(0->937) 00002000:00010000:2.0:1784938783.045312:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb0380 00000100:00100000:2.0:1784938783.045319:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326075648 00000100:00100000:2.0:1784938783.045321:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326075648 00002000:00100000:2.0:1784938783.045333:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xf:0x0] (0->6812) req@ffff974707fb3480 x1871643326075648/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 7304/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.045340:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb3480 with x1871643326075648 ext(0->6812) 00002000:00010000:2.0:1784938783.045343:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb3480 00000100:00100000:2.0:1784938783.045354:0:33062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:2.0:1784938783.045362:0:33062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+41:10023:x1871643326075264:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938783.047625:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+43:10024:x1871643326074752:12345-192.168.202.4@tcp:4:cp.0 Request processed in 10495us (10703us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1784938783.047638:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00002000:00100000:1.0:1784938783.047650:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x8:0x0] (0->28244) req@ffff974707fb0000 x1871643326074752/t4294967309(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 488/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938783.047660:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb0000 with x1871643326074752 ext(0->28244) 00002000:00010000:1.0:1784938783.047665:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb0000 00000100:00100000:1.0:1784938783.047693:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:1.0:1784938783.047704:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+42:10025:x1871643326075008:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938783.048310:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+44:10025:x1871643326075008:12345-192.168.202.4@tcp:4:cp.0 Request processed in 608us (3358us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1784938783.048317:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00002000:00100000:1.0:1784938783.048323:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa:0x0] (0->1612) req@ffff974707fb1880 x1871643326075008/t4294967310(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 2104/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938783.048329:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb1880 with x1871643326075008 ext(0->1612) 00002000:00010000:1.0:1784938783.048333:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb1880 00000100:00100000:1.0:1784938783.048346:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:1.0:1784938783.048352:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+43:10025:x1871643326075136:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938783.048544:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+45:10025:x1871643326075136:12345-192.168.202.4@tcp:4:cp.0 Request processed in 190us (3571us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1784938783.048551:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00002000:00100000:1.0:1784938783.048556:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xb:0x0] (0->837) req@ffff974707fb0a80 x1871643326075136/t4294967311(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 1328/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938783.049007:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb0a80 with x1871643326075136 ext(0->837) 00002000:00010000:1.0:1784938783.049011:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb0a80 00000100:00100000:1.0:1784938783.049029:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:1.0:1784938783.049037:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+44:10023:x1871643326075392:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938783.049659:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.052884:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+46:10023:x1871643326075392:12345-192.168.202.4@tcp:4:cp.0 Request processed in 3834us (7882us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1784938783.052900:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00002000:00100000:1.0:1784938783.052916:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xd:0x0] (0->3005) req@ffff974707fb1f80 x1871643326075392/t4294967312(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 3496/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938783.052926:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb1f80 with x1871643326075392 ext(0->3005) 00002000:00010000:1.0:1784938783.052933:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb1f80 00000100:00100000:1.0:1784938783.052969:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:1.0:1784938783.052984:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+45:10025:x1871643326075520:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938783.053439:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+47:10025:x1871643326075520:12345-192.168.202.4@tcp:4:cp.0 Request processed in 462us (8440us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1784938783.053444:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00002000:00100000:1.0:1784938783.053448:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe:0x0] (0->937) req@ffff974707fb0380 x1871643326075520/t4294967313(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 1432/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938783.053454:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb0380 with x1871643326075520 ext(0->937) 00002000:00010000:1.0:1784938783.053457:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb0380 00000100:00100000:1.0:1784938783.053467:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:1.0:1784938783.053472:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+46:10025:x1871643326075648:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938783.054841:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+48:10025:x1871643326075648:12345-192.168.202.4@tcp:4:cp.0 Request processed in 1363us (9824us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1784938783.054848:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00002000:00100000:1.0:1784938783.054855:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (0->6812) req@ffff974707fb3480 x1871643326075648/t4294967314(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 7304/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938783.054862:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb3480 with x1871643326075648 ext(0->6812) 00002000:00010000:1.0:1784938783.054865:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb3480 00000100:00100000:1.0:1784938783.054895:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326075904 00000100:00100000:1.0:1784938783.054902:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326075904 00000100:00100000:1.0:1784938783.054936:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:1.0:1784938783.054944:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+98:25037:x1871643326075904:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:1.0:1784938783.055149:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+99:25037:x1871643326075904:12345-192.168.202.4@tcp:35:cp.0 Request processed in 206us (5492us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1784938783.055153:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:3.0:1784938783.063917:0:33062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+48:10023:x1871643326075264:12345-192.168.202.4@tcp:4:cp.0 Request processed in 18546us (19095us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1784938783.063929:0:33062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00002000:00100000:3.0:1784938783.063942:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc:0x0] (0->18268) req@ffff974707fb0e00 x1871643326075264/t4294967315(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 488/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938783.063952:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974707fb0e00 with x1871643326075264 ext(0->18268) 00002000:00010000:3.0:1784938783.063958:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974707fb0e00 00000100:00100000:0.0:1784938783.074281:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.074396:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326076032 00000100:00100000:1.0:1784938783.074407:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326076032 00000100:00100000:1.0:1784938783.074467:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 107 00000100:00100000:1.0:1784938783.074476:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+99:25037:x1871643326076032:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.074502:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.074521:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5920 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074580:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074593:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074618:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074669:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074675:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074680:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074731:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074736:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074742:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074749:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.074791:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074798:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074807:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.074809:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.074812:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074822:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074831:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074834:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074838:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074841:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.074843:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074846:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074850:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x2893e4db (ffff97473a027b00) 00010000:00010000:1.0:1784938783.074851:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.074853:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074856:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074880:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a11 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5920 expref: 100 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074900:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.074902:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.074906:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5920 expref: 100 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.074915:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568600, rc 0) 00000100:00100000:1.0:1784938783.074973:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+99:25037:x1871643326076032:12345-192.168.202.4@tcp:101:cp.0 Request processed in 499us (703us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938783.074979:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 107 00000100:00100000:2.0:1784938783.078634:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.078781:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326076160 00000100:00100000:1.0:1784938783.078790:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326076160 00000100:00100000:1.0:1784938783.078848:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 108 00000100:00100000:1.0:1784938783.078858:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+99:25037:x1871643326076160:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.078877:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.078897:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07a26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5927 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.078959:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07a2d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.078973:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07a2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.078984:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07a2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.078998:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07a34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079021:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079029:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079096:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07a2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079103:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07a2d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079109:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07a2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079114:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.079118:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07a2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079125:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07a2d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079137:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.079139:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.079143:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07a2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079149:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07a2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079162:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079174:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07a34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079180:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07a34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079186:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.079189:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07a34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079195:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07a34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079204:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x2893e4db (ffff97473a027d00) 00010000:00010000:1.0:1784938783.079206:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.079209:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07a34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079215:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569600/0xcd9d312a94a07a34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079257:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07a26 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5927 expref: 100 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079268:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.079270:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.079273:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07a26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5927 expref: 100 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.079292:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568a00, rc 0) 00000100:00100000:1.0:1784938783.079361:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+99:25037:x1871643326076160:12345-192.168.202.4@tcp:101:cp.0 Request processed in 503us (736us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938783.079368:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 108 00000100:00100000:3.0:1784938783.084691:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.084926:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326076416 00000100:00100000:1.0:1784938783.084936:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326076416 00000100:00100000:1.0:1784938783.084993:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 109 00000100:00100000:1.0:1784938783.085003:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+99:25037:x1871643326076416:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.085024:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.085043:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a3b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d592e expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.085191:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.085205:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.085216:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.085230:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x2893e4db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.085247:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.085254:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938783.085737:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x10:0x0], index 1: 0 00010000:00010000:1.0:1784938783.085932:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a07a50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.085941:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a07a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.085949:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a07a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.085987:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.085995:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a42 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.086002:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.086008:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.086013:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.086020:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.086032:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.086035:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.086039:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.086056:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938783.086069:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000abd1d12c reply state 00000000bb3ce1b3 transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.086078:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938783.086108:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a3b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d592e expref: 102 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.086122:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a07a50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d592e expref: 101 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.086128:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff97473a027600) 00010000:00010000:1.0:1784938783.086130:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938783.086132:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568c00, rc 0) 00000100:00100000:1.0:1784938783.086209:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+102:25037:x1871643326076416:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1207us (1525us total) trans 4294967358 rc 0/0 00000100:00100000:1.0:1784938783.086217:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 109 00010000:00010000:1.0:1784938783.088916:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.088933:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.088940:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.088946:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.088964:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.088973:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.088988:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x2893e4db (ffff97473a027b00) 00010000:00010000:1.0:1784938783.088991:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.088995:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.089011:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07a49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2893e4db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.089413:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.090187:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326076544 00000100:00100000:1.0:1784938783.090198:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326076544 00000100:00080000:0.0:1784938783.090251:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938783.090276:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:1.0:1784938783.090288:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:10023:x1871643326076544:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.090306:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.090326:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07a5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5935 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938783.090353:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938783.090373:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=936s v=(0 0) 00010000:00010000:1.0:1784938783.090378:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938783.090387:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07a5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5935 expref: 32 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.090404:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07a5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5935 expref: 32 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.090429:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568a00, rc 0) 00000100:00100000:1.0:1784938783.090492:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:10023:x1871643326076544:12345-192.168.202.4@tcp:101:cp.0 Request processed in 207us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938783.090499:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:0.0:1784938783.092064:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974707fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342548992:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938783.092382:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938783.092453:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342548992 00000100:00100000:1.0:1784938783.092461:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342548992 00000100:00100000:1.0:1784938783.092525:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 15 00000100:00100000:1.0:1784938783.092535:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342548992:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938783.092555:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 11927552 granted 91947008 pending 23855104 free 390070272 avail 387973120 00000100:00100000:1.0:1784938783.092591:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342548992:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 58us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938783.092598:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 15 00000100:00080000:0.0:1784938783.092661:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938783.093623:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974707fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342548992:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938783.103597:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.103678:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326076672 00000100:00100000:0.0:1784938783.103688:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326076672 00000100:00100000:0.0:1784938783.103746:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:0.0:1784938783.103784:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:25037:x1871643326076672:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.103803:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.103821:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6454cd8/0xcd9d312a94a07a65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d593c expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.103849:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07a5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5935 expref: 33 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.103858:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.103861:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.103866:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6454cd8/0xcd9d312a94a07a65 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d593c expref: 33 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.103898:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07a5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5935 expref: 33 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.103910:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07a5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5935 expref: 33 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938783.103941:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97473f607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342549120:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938783.104040:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938783.107654:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.107742:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326076800 00000100:00100000:3.0:1784938783.107780:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326076800 00010000:00010000:3.0:1784938783.107824:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07a5e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5935 expref: 34 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.107863:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:3.0:1784938783.107874:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+34:10024:x1871643326076800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938783.107889:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938783.107912:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07a5e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5935 expref: 34 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.107928:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07a5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5935 expref: 34 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.107955:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.107959:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.107978:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6454cd8/0xcd9d312a94a07a65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d593c expref: 34 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.107988:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6454cd8/0xcd9d312a94a07a65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d593c expref: 34 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.108028:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e6454cd8/0xcd9d312a94a07a65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d593c expref: 34 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.108057:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027b8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342549248:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938783.108147:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026dbc00 going to sleep for 11 seconds 00010000:00010000:1.0:1784938783.111410:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07a5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5935 expref: 34 pid: 31428 timeout: 1036 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.111438:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97473f607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342549120:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938783.111471:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6454cd8/0xcd9d312a94a07a65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d593c expref: 33 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.111487:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250000, rc 0) 00000100:00100000:1.0:1784938783.111552:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:25037:x1871643326076672:12345-192.168.202.4@tcp:101:cp.0 Request processed in 7771us (7964us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938783.111562:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:3.0:1784938783.115386:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.115438:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027b8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342549248:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938783.115460:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938783.115509:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:10024:x1871643326076800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7638us (7864us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938783.115521:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:3.0:1784938783.115562:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326076928 00000100:00100000:3.0:1784938783.115568:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326076928 00002000:00100000:3.0:1784938783.115606:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->703) req@ffff9746027ba300 x1871643326076928/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 1192/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938783.115618:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746027ba300 with x1871643326076928 ext(0->703) 00002000:00010000:3.0:1784938783.115624:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746027ba300 00000100:00100000:3.0:1784938783.115645:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:3.0:1784938783.115653:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:10025:x1871643326076928:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938783.122928:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+34:10025:x1871643326076928:12345-192.168.202.4@tcp:4:cp.0 Request processed in 7262us (7538us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784938783.122942:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00002000:00100000:2.0:1784938783.122954:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x8:0x0] (0->703) req@ffff9746027ba300 x1871643326076928/t4294967308(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 1192/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.122963:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746027ba300 with x1871643326076928 ext(0->703) 00002000:00010000:2.0:1784938783.122969:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746027ba300 00000100:00100000:0.0:1784938783.138736:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.138801:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.138843:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.139729:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326077056 00000100:00100000:2.0:1784938783.139743:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326077056 00002000:00100000:2.0:1784938783.139809:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x9:0x0] (0->4914) req@ffff97473f607100 x1871643326077056/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 5408/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.139820:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f607100 with x1871643326077056 ext(0->4914) 00002000:00010000:2.0:1784938783.139826:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f607100 00000100:00100000:2.0:1784938783.139848:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326077696 00000100:00100000:2.0:1784938783.139852:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326077696 00002000:00100000:2.0:1784938783.139867:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe:0x0] (0->55539) req@ffff97473f55d880 x1871643326077696/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 488/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.139874:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55d880 with x1871643326077696 ext(0->55539) 00002000:00010000:2.0:1784938783.139878:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55d880 00000100:00100000:2.0:1784938783.139885:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326077184 00000100:00100000:2.0:1784938783.139887:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326077184 00002000:00100000:2.0:1784938783.139899:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa:0x0] (0->16000) req@ffff97472a1e7480 x1871643326077184/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 16496/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.139907:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1e7480 with x1871643326077184 ext(0->16000) 00002000:00010000:2.0:1784938783.139920:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97472a1e7480 00000100:00100000:2.0:1784938783.139934:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:2.0:1784938783.139942:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:10025:x1871643326077056:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938783.140451:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+38:10025:x1871643326077056:12345-192.168.202.4@tcp:4:cp.0 Request processed in 507us (1722us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1784938783.140460:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 21 00002000:00100000:2.0:1784938783.140468:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x9:0x0] (0->4914) req@ffff97473f607100 x1871643326077056/t4294967309(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 5408/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.140477:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f607100 with x1871643326077056 ext(0->4914) 00002000:00010000:2.0:1784938783.140481:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f607100 00000100:00100000:2.0:1784938783.140502:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:2.0:1784938783.140510:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+37:10023:x1871643326077696:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938783.140610:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:2.0:1784938783.140619:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+38:10024:x1871643326077184:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938783.140943:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+40:10024:x1871643326077184:12345-192.168.202.4@tcp:4:cp.0 Request processed in 324us (2097us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784938783.140950:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 23 00002000:00100000:2.0:1784938783.140956:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa:0x0] (0->16000) req@ffff97472a1e7480 x1871643326077184/t4294967310(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 16496/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.140964:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1e7480 with x1871643326077184 ext(0->16000) 00002000:00010000:2.0:1784938783.140969:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97472a1e7480 00000100:00100000:3.0:1784938783.146602:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.146654:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.146681:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.147612:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.147664:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.147688:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326077568 00000100:00100000:3.0:1784938783.147698:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326077568 00000100:00100000:2.0:1784938783.147950:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326077440 00000100:00100000:2.0:1784938783.147955:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326077440 00002000:00100000:2.0:1784938783.148006:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->4217) req@ffff974607d60a80 x1871643326077440/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 4712/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.148017:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974607d60a80 with x1871643326077440 ext(0->4217) 00002000:00010000:2.0:1784938783.148023:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974607d60a80 00000100:00100000:2.0:1784938783.148039:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326077312 00000100:00100000:2.0:1784938783.148043:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326077312 00002000:00100000:2.0:1784938783.148057:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (0->2857) req@ffff9747358f9c00 x1871643326077312/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 3352/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.148064:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9747358f9c00 with x1871643326077312 ext(0->2857) 00002000:00010000:2.0:1784938783.148067:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9747358f9c00 00000100:00100000:2.0:1784938783.148075:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326077824 00000100:00100000:2.0:1784938783.148077:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326077824 00002000:00100000:2.0:1784938783.148089:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xf:0x0] (0->6212) req@ffff974609ea1180 x1871643326077824/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 6704/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.148096:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974609ea1180 with x1871643326077824 ext(0->6212) 00002000:00010000:2.0:1784938783.148099:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974609ea1180 00000100:00100000:2.0:1784938783.148112:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:2.0:1784938783.148120:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+43:10026:x1871643326077440:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938783.148345:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326078080 00000100:00100000:1.0:1784938783.148417:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326078080 00000100:00100000:1.0:1784938783.148458:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:1.0:1784938783.148465:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+101:25037:x1871643326078080:12345-192.168.202.4@tcp:35:cp.0 00002000:00100000:3.0:1784938783.148820:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xd:0x0] (0->2191) req@ffff9746027b8700 x1871643326077568/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 2680/0 e 0 to 0 dl 1784938794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938783.148830:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746027b8700 with x1871643326077568 ext(0->2191) 00002000:00010000:3.0:1784938783.148835:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746027b8700 00000100:00100000:1.0:1784938783.149519:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+102:25037:x1871643326078080:12345-192.168.202.4@tcp:35:cp.0 Request processed in 1051us (2861us total) trans 4294967359 rc 0/0 00000100:00100000:1.0:1784938783.149528:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:2.0:1784938783.149589:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+45:10026:x1871643326077440:12345-192.168.202.4@tcp:4:cp.0 Request processed in 1469us (2906us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784938783.149596:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 24 00002000:00100000:2.0:1784938783.149603:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->4217) req@ffff974607d60a80 x1871643326077440/t4294967311(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 4712/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.149610:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974607d60a80 with x1871643326077440 ext(0->4217) 00002000:00010000:2.0:1784938783.149614:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974607d60a80 00000100:00100000:2.0:1784938783.149636:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:2.0:1784938783.149645:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+44:10023:x1871643326077312:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938783.149914:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+46:10023:x1871643326077312:12345-192.168.202.4@tcp:4:cp.0 Request processed in 269us (3209us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1784938783.149921:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 25 00002000:00100000:2.0:1784938783.149927:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (0->2857) req@ffff9747358f9c00 x1871643326077312/t4294967312(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 3352/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.149935:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9747358f9c00 with x1871643326077312 ext(0->2857) 00002000:00010000:2.0:1784938783.149939:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9747358f9c00 00000100:00100000:2.0:1784938783.149952:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:2.0:1784938783.149958:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+45:10023:x1871643326077824:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938783.150338:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+47:10023:x1871643326077824:12345-192.168.202.4@tcp:4:cp.0 Request processed in 237us (2531us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1784938783.150347:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00002000:00100000:2.0:1784938783.150427:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xf:0x0] (0->6212) req@ffff974609ea1180 x1871643326077824/t4294967313(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 6704/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.150435:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974609ea1180 with x1871643326077824 ext(0->6212) 00002000:00010000:2.0:1784938783.150438:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974609ea1180 00000100:00100000:2.0:1784938783.150454:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:2.0:1784938783.150461:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+46:10026:x1871643326077568:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938783.150661:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+48:10026:x1871643326077568:12345-192.168.202.4@tcp:4:cp.0 Request processed in 199us (4068us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1784938783.150668:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 27 00002000:00100000:2.0:1784938783.150679:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xd:0x0] (0->2191) req@ffff9746027b8700 x1871643326077568/t4294967314(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 2680/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.150686:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746027b8700 with x1871643326077568 ext(0->2191) 00002000:00010000:2.0:1784938783.150691:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746027b8700 00000100:00100000:2.0:1784938783.156509:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+48:10023:x1871643326077696:12345-192.168.202.4@tcp:4:cp.0 Request processed in 15991us (17698us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1784938783.156522:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 22 00002000:00100000:2.0:1784938783.156535:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe:0x0] (0->55539) req@ffff97473f55d880 x1871643326077696/t4294967315(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:259/0 lens 488/448 e 0 to 0 dl 1784938794 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938783.156545:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55d880 with x1871643326077696 ext(0->55539) 00002000:00010000:2.0:1784938783.156550:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55d880 00000100:00100000:0.0:1784938783.161686:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.161923:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326078208 00000100:00100000:1.0:1784938783.161934:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326078208 00000100:00100000:1.0:1784938783.161993:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 110 00000100:00100000:1.0:1784938783.162002:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+102:25037:x1871643326078208:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.162026:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.162046:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07a6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5943 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.162110:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.162124:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.162135:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.162149:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.162156:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.162175:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.162957:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.162966:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.162974:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.162981:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.162985:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.162993:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.163007:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.163010:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.163015:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.163021:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07a73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.163031:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.163038:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.163051:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.163056:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.163060:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.163066:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.163075:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x49aa722d (ffff97473a027700) 00010000:00010000:1.0:1784938783.163078:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.163080:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.163086:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07a7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.163124:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07a6c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5943 expref: 103 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.163134:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.163136:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.163140:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568a00/0xcd9d312a94a07a6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5943 expref: 103 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.163149:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568a00, rc 0) 00000100:00100000:1.0:1784938783.164314:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+102:25037:x1871643326078208:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2306us (2631us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938783.164336:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 110 00000100:00100000:1.0:1784938783.173861:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.173996:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326078336 00000100:00100000:3.0:1784938783.174006:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326078336 00000100:00100000:3.0:1784938783.174066:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 111 00000100:00100000:3.0:1784938783.174075:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+102:25037:x1871643326078336:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.174095:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.174116:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07a81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d594a expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174180:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07a88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174195:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174208:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174251:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ba00/0xcd9d312a94a07a8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174261:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ba00/0xcd9d312a94a07a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174268:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ba00/0xcd9d312a94a07a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174328:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174335:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07a88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174343:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07a88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174456:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209be00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.174461:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07a88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174470:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07a88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174484:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.174488:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.174493:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07a88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174501:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07a88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174521:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ba00/0xcd9d312a94a07a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174528:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ba00/0xcd9d312a94a07a8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174535:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ba00/0xcd9d312a94a07a8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174541:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209ba00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.174545:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ba00/0xcd9d312a94a07a8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174553:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ba00/0xcd9d312a94a07a8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174563:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x49aa722d (ffff9747052c8400) 00010000:00010000:3.0:1784938783.174565:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.174569:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ba00/0xcd9d312a94a07a8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174574:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ba00/0xcd9d312a94a07a8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174608:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07a81 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d594a expref: 103 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174618:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.174621:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.174631:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07a81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d594a expref: 103 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.174642:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209ae00, rc 0) 00000001:00080000:1.0:1784938783.174838:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1784938783.174904:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1784938783.175048:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+102:25037:x1871643326078336:12345-192.168.202.4@tcp:101:cp.0 Request processed in 627us (847us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938783.175057:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 111 00000100:00100000:1.0:1784938783.177887:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.177982:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326078592 00000100:00100000:2.0:1784938783.177992:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326078592 00000100:00100000:2.0:1784938783.178087:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 112 00000100:00100000:2.0:1784938783.178098:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+102:25037:x1871643326078592:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938783.178119:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938783.178140:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05e00/0xcd9d312a94a07a96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5951 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.178489:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07a9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.178504:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07a9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.178517:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07a9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.178551:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07aa4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x49aa722d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.178558:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.178565:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938783.179132:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11:0x0], index 0: 0 00010000:00010000:2.0:1784938783.180382:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05600/0xcd9d312a94a07aab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.180403:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05600/0xcd9d312a94a07aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.180415:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05600/0xcd9d312a94a07aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.180455:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07a9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.180462:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07a9d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.180469:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07a9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.180474:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.180478:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07a9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.180501:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07a9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.180515:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.180518:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.180522:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07a9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.180528:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07a9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938783.180543:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e11129b1 reply state 0000000019b3658c transno 4294967360 ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.180553:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938783.180594:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05e00/0xcd9d312a94a07a96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5951 expref: 105 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.180610:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05600/0xcd9d312a94a07aab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5951 expref: 104 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.180619:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff97473e984900) 00010000:00010000:2.0:1784938783.180621:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938783.180624:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05600, rc 0) 00000100:00100000:2.0:1784938783.180712:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+105:25037:x1871643326078592:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2615us (2832us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1784938783.180722:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 112 00010000:00010000:0.0:1784938783.185156:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.185175:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07aa4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.185182:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07aa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.185189:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.185193:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07aa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.185201:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07aa4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.185219:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x49aa722d (ffff97473e984200) 00010000:00010000:0.0:1784938783.185222:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.185228:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07aa4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.185246:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07aa4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x49aa722d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.187699:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.188570:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326078720 00000100:00100000:3.0:1784938783.188583:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326078720 00000100:00100000:3.0:1784938783.188667:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:3.0:1784938783.188679:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+20:10026:x1871643326078720:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.188698:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.188730:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a07ab9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5958 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938783.188776:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938783.188798:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=937s v=(0 0) 00010000:00010000:3.0:1784938783.188804:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.188813:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a07ab9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5958 expref: 21 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.188832:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a07ab9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5958 expref: 21 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.188845:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209ae00, rc 0) 00000100:00100000:3.0:1784938783.188906:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+21:10026:x1871643326078720:12345-192.168.202.4@tcp:101:cp.0 Request processed in 231us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938783.188928:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:2.0:1784938783.193246:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.193315:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326078848 00000100:00100000:1.0:1784938783.193325:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326078848 00000100:00100000:1.0:1784938783.193393:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:1.0:1784938783.193403:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+21:25037:x1871643326078848:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.193926:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.193949:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07ac0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d595f expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.193984:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a07ab9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5958 expref: 22 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.193994:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938783.193999:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938783.194005:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07ac0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d595f expref: 22 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.194038:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a07ab9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5958 expref: 22 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.194054:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a07ab9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5958 expref: 22 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.194081:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342549376:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938783.194179:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938783.197733:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.197961:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326078976 00000100:00100000:3.0:1784938783.197970:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326078976 00010000:00010000:3.0:1784938783.198005:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a07ab9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5958 expref: 23 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.198043:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:3.0:1784938783.198051:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:10026:x1871643326078976:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938783.198066:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938783.198087:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a07ab9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5958 expref: 23 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.198102:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a07ab9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5958 expref: 23 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.198125:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.198129:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.198137:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07ac0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d595f expref: 23 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.198148:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07ac0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d595f expref: 23 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.198183:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07ac0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d595f expref: 23 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.198210:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342549504:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938783.198212:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a07ab9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5958 expref: 23 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938783.198259:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342549376:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938783.198285:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07ac0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d595f expref: 22 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.198297:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568a00, rc 0) 00000100:00100000:0.0:1784938783.199409:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+22:25037:x1871643326078848:12345-192.168.202.4@tcp:101:cp.0 Request processed in 6000us (6173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938783.199600:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:1.0:1784938783.199689:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026dbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938783.202190:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342549504:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938783.202728:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938783.203129:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+21:10026:x1871643326078976:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5076us (5404us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938783.203142:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:2.0:1784938783.205102:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.205161:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326079232 00000100:00100000:3.0:1784938783.205171:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326079232 00000100:00100000:3.0:1784938783.205434:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:3.0:1784938783.205446:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+104:25037:x1871643326079232:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938783.205852:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+105:25037:x1871643326079232:12345-192.168.202.4@tcp:35:cp.0 Request processed in 405us (756us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1784938783.205861:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:0.0:1784938783.211398:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.211575:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326079360 00000100:00100000:1.0:1784938783.211586:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326079360 00000100:00100000:1.0:1784938783.211651:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:1.0:1784938783.211662:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+105:25037:x1871643326079360:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.211691:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.211722:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07ac7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5966 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.211823:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07ace lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.211837:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07ace lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.211849:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07ace lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.211864:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ad5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.211883:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.211891:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.211956:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07ace lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.211964:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07ace lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.211971:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07ace lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.211978:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.211982:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07ace lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.211990:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07ace lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.212002:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.212005:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.212009:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07ace lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.212016:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07ace lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.212029:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.212040:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ad5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.212047:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.212053:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.212056:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.212063:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.212070:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4c7a76ee (ffff97473a027700) 00010000:00010000:1.0:1784938783.212073:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.212075:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ad5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.212082:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ad5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.212114:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07ac7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5966 expref: 106 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.212124:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.212126:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.212130:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07ac7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5966 expref: 106 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.212152:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569e00, rc 0) 00000100:00100000:1.0:1784938783.212482:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+105:25037:x1871643326079360:12345-192.168.202.4@tcp:101:cp.0 Request processed in 821us (1093us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938783.212491:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:2.0:1784938783.219567:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.222885:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326079488 00000100:00100000:1.0:1784938783.222899:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326079488 00000100:00100000:1.0:1784938783.223046:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:1.0:1784938783.223058:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+105:25037:x1871643326079488:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.223081:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.223106:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07adc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d596d expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.223171:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ae3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.223187:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.223209:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.223224:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07aea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.223230:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.223267:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223647:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223656:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ae3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223664:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ae3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223670:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.223674:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ae3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223682:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ae3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223696:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.223699:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.223712:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ae3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223719:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07ae3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223733:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223739:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07aea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223745:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07aea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223790:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.223793:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07aea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223800:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07aea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223807:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4c7a76ee (ffff97473a027700) 00010000:00010000:0.0:1784938783.223809:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.223812:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07aea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223818:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07aea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223855:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07adc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d596d expref: 106 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223877:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.223879:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.223883:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07adc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d596d expref: 106 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.223893:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569e00, rc 0) 00000100:00100000:0.0:1784938783.223976:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+105:25037:x1871643326079488:12345-192.168.202.4@tcp:101:cp.0 Request processed in 920us (4418us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938783.223985:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:2.0:1784938783.228584:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.228667:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326079744 00000100:00100000:3.0:1784938783.228678:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326079744 00000100:00100000:3.0:1784938783.228744:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 115 00000100:00100000:3.0:1784938783.228775:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+105:25037:x1871643326079744:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.228797:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.228823:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ba00/0xcd9d312a94a07af1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5974 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.228954:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07af8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.228967:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07af8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.228980:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07af8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.228994:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07aff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.229016:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.229022:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938783.229583:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11:0x0], index 1: 0 00010000:00010000:3.0:1784938783.229731:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ac00/0xcd9d312a94a07b06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.229741:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ac00/0xcd9d312a94a07b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.229775:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ac00/0xcd9d312a94a07b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.229813:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07af8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.229820:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07af8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.229826:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07af8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.229832:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209be00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.229836:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07af8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.229843:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07af8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.229866:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.229869:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.229874:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07af8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.229881:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07af8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938783.229894:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007cee390d reply state 000000002b3724ac transno 4294967362 ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.229902:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938783.229934:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ba00/0xcd9d312a94a07af1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5974 expref: 108 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.229948:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ac00/0xcd9d312a94a07b06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5974 expref: 107 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.229958:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9747052c8a00) 00010000:00010000:3.0:1784938783.229960:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938783.229963:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209ac00, rc 0) 00000100:00100000:3.0:1784938783.230040:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+108:25037:x1871643326079744:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1285us (1687us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1784938783.230048:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 115 00010000:00010000:1.0:1784938783.233812:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.233833:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07aff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.233841:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07aff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.233847:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209b200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.233852:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07aff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.233859:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07aff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.233877:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4c7a76ee (ffff9747052c8100) 00010000:00010000:1.0:1784938783.233880:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.233885:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07aff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.233890:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07aff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4c7a76ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.236886:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.237045:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326079872 00000100:00100000:1.0:1784938783.237056:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326079872 00000100:00100000:1.0:1784938783.237118:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:1.0:1784938783.237127:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+48:10023:x1871643326079872:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.237145:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.237180:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07b14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d597b expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938783.237220:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938783.237250:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=937s v=(0 0) 00010000:00010000:1.0:1784938783.237255:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938783.237264:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07b14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d597b expref: 49 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.237287:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07b14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d597b expref: 49 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.237301:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569c00, rc 0) 00000100:00100000:1.0:1784938783.237374:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+49:10023:x1871643326079872:12345-192.168.202.4@tcp:101:cp.0 Request processed in 248us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938783.237381:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:3.0:1784938783.240066:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.240315:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326080000 00000100:00100000:0.0:1784938783.240326:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326080000 00000100:00100000:0.0:1784938783.240396:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:0.0:1784938783.240406:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+49:25037:x1871643326080000:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.240442:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.240463:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d1f0eb5/0xcd9d312a94a07b1b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5982 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.240494:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07b14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d597b expref: 50 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.240504:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.240508:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.240513:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d1f0eb5/0xcd9d312a94a07b1b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5982 expref: 50 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.240568:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07b14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d597b expref: 50 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.240583:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07b14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d597b expref: 50 pid: 31425 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938783.240599:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342549632:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938783.241026:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470507d900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938783.244307:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.245342:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326080128 00000100:00100000:1.0:1784938783.245366:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326080128 00010000:00010000:1.0:1784938783.245436:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07b14 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d597b expref: 51 pid: 31425 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.245491:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:1.0:1784938783.245501:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:10023:x1871643326080128:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938783.245521:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938783.245551:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07b14 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d597b expref: 51 pid: 31425 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.245587:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07b14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d597b expref: 51 pid: 31425 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.245616:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938783.245621:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938783.245630:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d1f0eb5/0xcd9d312a94a07b1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5982 expref: 51 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.245642:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d1f0eb5/0xcd9d312a94a07b1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5982 expref: 51 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.245685:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001d1f0eb5/0xcd9d312a94a07b1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5982 expref: 51 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.245700:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342549760:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938783.245815:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9a80 going to sleep for 11 seconds 00010000:00010000:0.0:1784938783.247714:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07b14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d597b expref: 51 pid: 31425 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938783.247748:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31427:1871643342549632:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938783.247818:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001d1f0eb5/0xcd9d312a94a07b1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5982 expref: 50 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.247834:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251000, rc 0) 00000100:00100000:0.0:1784938783.247961:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+50:25037:x1871643326080000:12345-192.168.202.4@tcp:101:cp.0 Request processed in 7555us (7906us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938783.247970:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:1.0:1784938783.252496:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342549760:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938783.252522:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938783.252578:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+49:10023:x1871643326080128:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7077us (8291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938783.252589:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:3.0:1784938783.253730:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.253958:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326080384 00000100:00100000:1.0:1784938783.253966:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326080384 00000100:00100000:1.0:1784938783.254017:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:1.0:1784938783.254039:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+107:25037:x1871643326080384:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:1.0:1784938783.254392:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+108:25037:x1871643326080384:12345-192.168.202.4@tcp:35:cp.0 Request processed in 353us (665us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1784938783.254401:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:3.0:1784938783.257535:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.257797:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326080512 00000100:00100000:2.0:1784938783.257809:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326080512 00000100:00100000:2.0:1784938783.257876:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 116 00000100:00100000:2.0:1784938783.257886:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+108:25037:x1871643326080512:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938783.257967:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938783.257991:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a07b22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5989 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258076:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258090:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258103:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258117:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258124:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258130:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258196:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258209:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258215:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258220:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.258225:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258242:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258323:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.258327:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.258333:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258339:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258351:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258357:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258362:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258367:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.258377:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258384:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258392:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x610aa076 (ffff97473e984e00) 00010000:00010000:2.0:1784938783.258394:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.258397:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258402:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258438:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a07b22 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5989 expref: 109 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258448:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.258450:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.258454:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a07b22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5989 expref: 109 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.258463:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05800, rc 0) 00000100:00100000:2.0:1784938783.258531:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+108:25037:x1871643326080512:12345-192.168.202.4@tcp:101:cp.0 Request processed in 646us (1005us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938783.258538:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 116 00000100:00100000:2.0:1784938783.262666:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.262837:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326080640 00000100:00100000:1.0:1784938783.262848:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326080640 00000100:00100000:1.0:1784938783.262904:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 117 00000100:00100000:1.0:1784938783.262913:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+108:25037:x1871643326080640:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.262934:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.262955:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07b37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5990 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263019:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263034:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263046:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263061:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263069:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263076:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263155:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263163:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263170:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263176:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.263180:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263187:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263329:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.263333:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.263338:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263346:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263734:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263742:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263748:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263780:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.263784:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263792:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263801:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x610aa076 (ffff97473a027300) 00010000:00010000:1.0:1784938783.263804:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.263807:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263814:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263852:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07b37 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5990 expref: 109 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263862:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.263865:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.263869:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07b37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5990 expref: 109 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.263880:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569c00, rc 0) 00000100:00100000:1.0:1784938783.263948:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+108:25037:x1871643326080640:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1035us (1293us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938783.263956:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 117 00000100:00100000:0.0:1784938783.272672:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.272802:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326080896 00000100:00100000:2.0:1784938783.272814:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326080896 00000100:00100000:2.0:1784938783.272949:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:2.0:1784938783.272974:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+108:25037:x1871643326080896:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938783.272997:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938783.273020:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a07b4c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5997 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.273166:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b53 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.273182:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.273194:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.273210:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x610aa076 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.273217:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.273224:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938783.273816:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12:0x0], index 0: 0 00010000:00010000:2.0:1784938783.273988:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05a00/0xcd9d312a94a07b61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.274000:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05a00/0xcd9d312a94a07b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.274008:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05a00/0xcd9d312a94a07b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.274053:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.274061:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b53 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.274067:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.274073:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.274076:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.274083:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b53 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.274096:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.274099:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.274105:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.274111:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938783.274123:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052626fe7 reply state 0000000080a2db2e transno 4294967364 ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.274133:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938783.274165:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a07b4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5997 expref: 111 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.274194:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05a00/0xcd9d312a94a07b61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5997 expref: 110 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.274201:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff97473e984800) 00010000:00010000:2.0:1784938783.274203:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938783.274206:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05a00, rc 0) 00000100:00100000:2.0:1784938783.274296:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+111:25037:x1871643326080896:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1325us (1632us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1784938783.274305:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:0.0:1784938783.274437:0:31529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31529:1871643342549888:192.168.202.104@tcp:5:osp-pre-0-0.0 00000100:00100000:0.0:1784938783.274503:0:31529:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470507d900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938783.274718:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938783.274789:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342549888 00000100:00100000:1.0:1784938783.274796:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342549888 00000100:00100000:1.0:1784938783.274835:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 74 00000100:00100000:1.0:1784938783.274844:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:31529:x1871643342549888:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1784938783.274886:0:31425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 34 00002000:00080000:1.0:1784938783.283143:0:31425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 42 00010000:00010000:0.0:1784938783.287219:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.287256:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.287264:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.287270:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.287275:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.287284:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.287310:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x610aa076 (ffff97473e984e00) 00010000:00010000:0.0:1784938783.287313:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.287318:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.287324:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07b5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x610aa076 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.299198:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.299302:0:31427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1784938783.299314:0:31427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1784938783.299680:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326081024 00000100:00100000:0.0:1784938783.299689:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326081024 00000100:00100000:3.0:1784938783.299907:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:3.0:1784938783.299920:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+21:10026:x1871643326081024:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.299941:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.299962:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07b6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d599e expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938783.299989:0:33065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938783.300008:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=937s v=(0 0) 00010000:00010000:3.0:1784938783.300013:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.300022:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07b6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d599e expref: 22 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.300039:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07b6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d599e expref: 22 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.300052:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209ba00, rc 0) 00000100:00100000:3.0:1784938783.300243:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+22:10026:x1871643326081024:12345-192.168.202.4@tcp:101:cp.0 Request processed in 317us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938783.300252:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00000001:00080000:2.0:1784938783.301603:0:31425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967316 00002000:00080000:2.0:1784938783.301999:0:31425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 50 00000001:00080000:2.0:1784938783.308167:0:31425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00002000:00080000:2.0:1784938783.308311:0:31425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 58 00000001:00080000:2.0:1784938783.317577:0:31425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000100:00100000:2.0:1784938783.319577:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:31529:x1871643342549888:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 Request processed in 44723us (44850us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1784938783.319593:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 74 00000020:00080000:2.0:1784938783.319600:0:31425:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00100000:3.0:1784938783.320225:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.320431:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326081152 00000100:00100000:1.0:1784938783.320441:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326081152 00000100:00100000:1.0:1784938783.320488:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:1.0:1784938783.320497:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+22:25037:x1871643326081152:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.320514:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.320534:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003598b9f9/0xcd9d312a94a07b76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d59a5 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.320564:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07b6f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d599e expref: 23 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.320573:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938783.320577:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938783.320583:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003598b9f9/0xcd9d312a94a07b76 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59a5 expref: 23 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.320616:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07b6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d599e expref: 23 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.320630:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07b6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d599e expref: 23 pid: 33065 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.320673:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602691f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342550016:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938783.322305:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938783.330115:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.330345:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602691f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342550016:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938783.330382:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003598b9f9/0xcd9d312a94a07b76 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59a5 expref: 23 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.330406:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569600, rc 0) 00000100:00100000:1.0:1784938783.330473:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:25037:x1871643326081152:12345-192.168.202.4@tcp:101:cp.0 Request processed in 9975us (10248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938783.330482:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:2.0:1784938783.330667:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326081280 00000100:00100000:2.0:1784938783.330675:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326081280 00010000:00010000:2.0:1784938783.330709:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07b6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d599e expref: 23 pid: 33065 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.330981:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:2.0:1784938783.330993:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:10026:x1871643326081280:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938783.331008:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938783.331048:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07b6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d599e expref: 23 pid: 33065 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.331062:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07b6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d599e expref: 23 pid: 33065 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.331085:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07b6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d599e expref: 23 pid: 33065 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.331100:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.331104:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.331113:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003598b9f9/0xcd9d312a94a07b76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59a5 expref: 22 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.331123:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003598b9f9/0xcd9d312a94a07b76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59a5 expref: 22 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.331178:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003598b9f9/0xcd9d312a94a07b76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59a5 expref: 22 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.331192:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703410700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342550144:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938783.331269:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a8229c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938783.331995:0:31529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31529:1871643342549888:192.168.202.104@tcp:5:osp-pre-0-0.0 00000004:00080000:0.0:1784938783.332010:0:31529:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x12:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:3.0:1784938783.345174:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.345331:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703410700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342550144:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938783.345363:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938783.345431:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+22:10026:x1871643326081280:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 14440us (15327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938783.345463:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:1.0:1784938783.345613:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326081536 00000100:00100000:1.0:1784938783.345620:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326081536 00000100:00100000:1.0:1784938783.345683:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:1.0:1784938783.345694:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705cdb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+110:25037:x1871643326081536:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:1.0:1784938783.346102:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705cdb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+111:25037:x1871643326081536:12345-192.168.202.4@tcp:35:cp.0 Request processed in 409us (938us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1784938783.346109:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:3.0:1784938783.352637:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.352796:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326081664 00000100:00100000:1.0:1784938783.352807:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326081664 00000100:00100000:1.0:1784938783.352885:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:1.0:1784938783.352897:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+111:25037:x1871643326081664:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.352926:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.352949:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07b7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d59ac expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353046:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353061:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353071:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353087:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353094:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353101:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353167:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353175:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353182:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353188:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.353192:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353211:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353224:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.353228:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.353250:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353256:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07b84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353275:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353281:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353287:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353293:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.353295:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353302:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353309:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x72a71b3d (ffff97473a027300) 00010000:00010000:1.0:1784938783.353312:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.353315:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353330:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07b8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353368:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07b7d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59ac expref: 112 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353379:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.353381:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.353385:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07b7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59ac expref: 112 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.353395:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569c00, rc 0) 00000100:00100000:1.0:1784938783.353686:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+111:25037:x1871643326081664:12345-192.168.202.4@tcp:101:cp.0 Request processed in 790us (1058us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938783.353694:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:3.0:1784938783.367109:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.367230:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326081792 00000100:00100000:2.0:1784938783.367251:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326081792 00000100:00100000:2.0:1784938783.367318:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:2.0:1784938783.367330:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+111:25037:x1871643326081792:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938783.367349:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938783.367380:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a07b92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d59b3 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367448:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367463:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367474:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367491:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07ba0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367498:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367505:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367569:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367593:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367604:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367610:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.367616:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367623:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367648:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.367652:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.367656:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367662:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05000/0xcd9d312a94a07b99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367674:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367679:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367684:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367689:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.367703:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367709:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367717:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x72a71b3d (ffff97473e984c00) 00010000:00010000:2.0:1784938783.367719:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.367722:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07ba0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.367728:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07ba0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.369427:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a07b92 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59b3 expref: 112 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.369446:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.369448:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.369453:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a07b92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59b3 expref: 112 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.369468:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05800, rc 0) 00000100:00100000:2.0:1784938783.369549:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+111:25037:x1871643326081792:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2220us (2449us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938783.369559:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:3.0:1784938783.376117:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.376213:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326082048 00000100:00100000:2.0:1784938783.376223:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326082048 00000100:00100000:2.0:1784938783.376296:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:2.0:1784938783.376306:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+111:25037:x1871643326082048:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938783.376340:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938783.376377:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07ba7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d59ba expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.376529:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07bae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.376546:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07bae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.376559:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07bae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.376574:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07bb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.376581:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.376588:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.377487:0:32343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602693b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32343:1871643342550272:192.168.202.104@tcp:5:osp-pre-1-0.0 00000100:00100000:1.0:1784938783.377579:0:32343:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938783.377833:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938783.377957:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342550272 00000100:00100000:1.0:1784938783.377963:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342550272 00000100:00100000:1.0:1784938783.378018:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 77 00000100:00100000:1.0:1784938783.378027:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:32343:x1871643342550272:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1784938783.378067:0:33065:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 34 00000100:00080000:0.0:1784938783.378817:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1784938783.379544:0:33061:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12:0x0], index 1: 0 00010000:00010000:3.0:1784938783.380957:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07bbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.380980:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.380992:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.381032:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07bae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.381039:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07bae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.381045:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07bae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.381052:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.381057:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07bae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.381064:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07bae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.381075:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.381079:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.381083:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07bae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.381089:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07bae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938783.381113:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc1694a7 reply state 00000000e60f48c7 transno 4294967366 ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.381122:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938783.381159:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07ba7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59ba expref: 114 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.381172:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07bbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59ba expref: 113 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.381179:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9747052c8500) 00010000:00010000:3.0:1784938783.381182:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938783.381185:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209be00, rc 0) 00000100:00100000:3.0:1784938783.381273:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+114:25037:x1871643326082048:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4968us (5167us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1784938783.381281:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 121 00010000:00010000:2.0:1784938783.383986:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.384005:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07bb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.384012:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.384018:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.384030:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.384038:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07bb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.384054:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x72a71b3d (ffff97473e984b00) 00010000:00010000:2.0:1784938783.384057:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.384062:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07bb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.384069:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07bb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x72a71b3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.387599:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.388033:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326082176 00000100:00100000:3.0:1784938783.388046:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326082176 00000100:00100000:3.0:1784938783.388112:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:3.0:1784938783.388123:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+49:10023:x1871643326082176:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.388143:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.388165:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a07bca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d59c1 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938783.388193:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938783.388215:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=937s v=(0 0) 00010000:00010000:3.0:1784938783.388250:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.388260:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a07bca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c1 expref: 50 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.388280:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a07bca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c1 expref: 50 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.388295:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209a400, rc 0) 00000100:00100000:3.0:1784938783.388364:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+50:10023:x1871643326082176:12345-192.168.202.4@tcp:101:cp.0 Request processed in 242us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938783.388370:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 78 00002000:00080000:1.0:1784938783.390055:0:33065:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 42 00000001:00080000:1.0:1784938783.396481:0:33065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967316 00002000:00080000:1.0:1784938783.396998:0:33065:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 50 00000100:00100000:0.0:1784938783.397913:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.398214:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326082304 00000100:00100000:2.0:1784938783.398223:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326082304 00000100:00100000:2.0:1784938783.398292:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:2.0:1784938783.398302:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+50:25037:x1871643326082304:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938783.398319:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938783.398340:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a07bd1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d59c8 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.398382:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a07bca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c1 expref: 51 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.398391:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.398395:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.398400:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a07bd1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c8 expref: 51 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.398440:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a07bca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c1 expref: 51 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.398454:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a07bca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c1 expref: 51 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.398467:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703410000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:31425:1871643342550400:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938783.398553:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938783.403953:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.404093:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703410000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:31425:1871643342550400:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938783.404132:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a07bd1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c8 expref: 51 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.404155:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05000, rc 0) 00000100:00100000:3.0:1784938783.404224:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:25037:x1871643326082304:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5922us (6315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938783.404243:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:1.0:1784938783.405279:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326082432 00000100:00100000:1.0:1784938783.405307:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326082432 00010000:00010000:1.0:1784938783.405342:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a07bca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c1 expref: 51 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.405384:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:1.0:1784938783.405394:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703410380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:10023:x1871643326082432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938783.405408:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938783.405432:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a07bca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c1 expref: 51 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.405447:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a07bca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c1 expref: 51 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.405469:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a07bca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c1 expref: 51 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.405485:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938783.405489:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938783.405497:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a07bd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c8 expref: 50 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.405506:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a07bd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c8 expref: 50 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.405544:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a07bd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c8 expref: 50 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.405584:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602691f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342550528:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938783.405665:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718c1fb40 going to sleep for 11 seconds 00000001:00080000:0.0:1784938783.408961:0:33065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00002000:00080000:0.0:1784938783.409104:0:33065:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 58 00000001:00080000:0.0:1784938783.413987:0:33065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000100:00100000:0.0:1784938783.414180:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:32343:x1871643342550272:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 Request processed in 36150us (36345us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1784938783.414188:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 77 00000020:00080000:0.0:1784938783.414192:0:33065:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00100000:3.0:1784938783.414907:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.415376:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602691f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342550528:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938783.415402:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938783.415446:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703410380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+50:10023:x1871643326082432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10053us (11505us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938783.415455:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:1.0:1784938783.416418:0:32343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602693b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32343:1871643342550272:192.168.202.104@tcp:5:osp-pre-1-0.0 00000004:00080000:1.0:1784938783.416434:0:32343:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x12:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1784938783.416463:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326082688 00000100:00100000:1.0:1784938783.416469:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326082688 00000100:00100000:0.0:1784938783.416787:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:0.0:1784938783.416799:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+113:25037:x1871643326082688:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938783.417160:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+114:25037:x1871643326082688:12345-192.168.202.4@tcp:35:cp.0 Request processed in 362us (2256us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1784938783.417168:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:2.0:1784938783.423937:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.424014:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326082816 00000100:00100000:0.0:1784938783.424023:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326082816 00000100:00100000:0.0:1784938783.424099:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:0.0:1784938783.424107:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+114:25037:x1871643326082816:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.424129:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.424150:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07bd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d59cf expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424205:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bdf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424216:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424224:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424261:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07be6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424272:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424282:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424352:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424360:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bdf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424366:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424373:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.424378:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424385:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bdf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424397:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.424401:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.424405:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424412:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424434:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424441:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07be6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424447:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07be6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424451:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741250800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.424455:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07be6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424462:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07be6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424469:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa9dd9870 (ffff974705478f00) 00010000:00010000:0.0:1784938783.424471:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.424474:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07be6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424481:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07be6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424514:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07bd8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59cf expref: 115 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424523:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.424525:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.424536:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07bd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59cf expref: 115 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.424545:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251600, rc 0) 00000100:00100000:0.0:1784938783.424628:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+114:25037:x1871643326082816:12345-192.168.202.4@tcp:101:cp.0 Request processed in 521us (752us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938783.424636:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:0.0:1784938783.441113:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.441217:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326082944 00000100:00100000:1.0:1784938783.441228:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326082944 00000100:00100000:0.0:1784938783.441464:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:0.0:1784938783.441475:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+114:25037:x1871643326082944:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.441498:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.441523:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07bed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d59d6 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441595:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07bf4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441610:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07bf4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441622:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07bf4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441637:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441644:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441650:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441734:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07bf4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441742:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07bf4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441748:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07bf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441778:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741250800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.441783:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07bf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441792:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07bf4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441805:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.441807:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.441812:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07bf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441818:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07bf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441831:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441836:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bfb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441842:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441854:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.441858:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441863:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bfb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441871:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa9dd9870 (ffff974705478f00) 00010000:00010000:0.0:1784938783.441873:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.441890:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bfb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441897:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07bfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441933:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07bed lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59d6 expref: 115 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441943:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.441945:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.441949:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07bed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59d6 expref: 115 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.441958:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251600, rc 0) 00000100:00100000:0.0:1784938783.442022:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+114:25037:x1871643326082944:12345-192.168.202.4@tcp:101:cp.0 Request processed in 549us (917us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938783.442029:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:1.0:1784938783.451841:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.452019:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326083200 00000100:00100000:2.0:1784938783.452031:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326083200 00000100:00100000:2.0:1784938783.452092:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00100000:2.0:1784938783.452102:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+114:25037:x1871643326083200:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938783.452123:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938783.452144:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07c02 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d59dd expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.452279:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07c09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.452306:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07c09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.452317:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07c09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.452332:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07c10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.452340:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07c10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.452347:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07c10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938783.453379:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13:0x0], index 0: 0 00010000:00010000:2.0:1784938783.453564:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05e00/0xcd9d312a94a07c17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.453576:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05e00/0xcd9d312a94a07c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.453585:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05e00/0xcd9d312a94a07c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.453624:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07c09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.453631:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07c09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.455636:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07c09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.455677:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.455682:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07c09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.455691:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07c09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.455708:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.455711:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.455716:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07c09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.455723:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07c09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938783.455741:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ace1071c reply state 0000000023aad38e transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07c10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.456130:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938783.456187:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07c02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59dd expref: 117 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.456204:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05e00/0xcd9d312a94a07c17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59dd expref: 116 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.456212:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff97473e984c00) 00010000:00010000:2.0:1784938783.456215:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938783.456218:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05e00, rc 0) 00000100:00100000:2.0:1784938783.456307:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+117:25037:x1871643326083200:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4205us (4474us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1784938783.456321:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 124 00010000:00010000:0.0:1784938783.460438:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07c10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.460472:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07c10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.460481:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07c10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.460488:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.460493:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07c10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.460501:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07c10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.460518:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa9dd9870 (ffff97473e984b00) 00010000:00010000:0.0:1784938783.460521:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.460526:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07c10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.460533:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07c10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xa9dd9870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.471663:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.472066:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326083328 00000100:00100000:0.0:1784938783.472077:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326083328 00000100:00100000:0.0:1784938783.472142:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:0.0:1784938783.472153:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+22:10026:x1871643326083328:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.472173:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.472195:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069a43c13/0xcd9d312a94a07c25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d59e4 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938783.472254:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938783.472275:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=937s v=(0 0) 00010000:00010000:0.0:1784938783.472280:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.472289:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069a43c13/0xcd9d312a94a07c25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59e4 expref: 23 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.472306:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069a43c13/0xcd9d312a94a07c25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59e4 expref: 23 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.472320:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251400, rc 0) 00000100:00100000:0.0:1784938783.472388:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:10026:x1871643326083328:12345-192.168.202.4@tcp:101:cp.0 Request processed in 237us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938783.472396:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:2.0:1784938783.491833:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.495600:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326083456 00000100:00100000:3.0:1784938783.495621:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326083456 00000100:00100000:3.0:1784938783.495710:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:3.0:1784938783.495721:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:25037:x1871643326083456:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.495747:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.495801:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07c2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d59eb expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.495854:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069a43c13/0xcd9d312a94a07c25 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59e4 expref: 24 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.495864:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.495868:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.495873:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07c2c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59eb expref: 24 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.495914:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069a43c13/0xcd9d312a94a07c25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59e4 expref: 24 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.495932:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069a43c13/0xcd9d312a94a07c25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59e4 expref: 24 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.495948:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342550656:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938783.496051:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938783.509591:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.509686:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326083584 00000100:00100000:2.0:1784938783.509695:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326083584 00010000:00010000:2.0:1784938783.509738:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069a43c13/0xcd9d312a94a07c25 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59e4 expref: 25 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.509806:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:2.0:1784938783.509815:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:10025:x1871643326083584:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938783.509831:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938783.509856:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069a43c13/0xcd9d312a94a07c25 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59e4 expref: 25 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.509870:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069a43c13/0xcd9d312a94a07c25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59e4 expref: 25 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.509896:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.509901:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.509909:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07c2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59eb expref: 25 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.509919:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07c2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59eb expref: 25 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.509956:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07c2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59eb expref: 25 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.509987:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703412a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342550784:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938783.510068:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822000 going to sleep for 11 seconds 00010000:00010000:3.0:1784938783.511070:0:31425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069a43c13/0xcd9d312a94a07c25 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59e4 expref: 25 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.511091:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342550656:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938783.511117:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07c2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59eb expref: 24 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.511147:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209ba00, rc 0) 00000100:00100000:3.0:1784938783.511246:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+24:25037:x1871643326083456:12345-192.168.202.4@tcp:101:cp.0 Request processed in 15526us (19422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938783.511255:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:2.0:1784938783.514426:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703412a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342550784:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938783.514450:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938783.514505:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:10025:x1871643326083584:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4690us (4923us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938783.514517:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:0.0:1784938783.527102:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.527188:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326083840 00000100:00100000:3.0:1784938783.527198:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326083840 00000100:00100000:3.0:1784938783.527265:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:3.0:1784938783.527276:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+116:25037:x1871643326083840:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938783.527673:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+117:25037:x1871643326083840:12345-192.168.202.4@tcp:35:cp.0 Request processed in 398us (581us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1784938783.527680:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:1.0:1784938783.544689:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.544857:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326083968 00000100:00100000:3.0:1784938783.544869:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326083968 00000100:00100000:3.0:1784938783.544943:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:3.0:1784938783.544953:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+117:25037:x1871643326083968:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.544981:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.545007:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07c33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d59f2 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545071:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545085:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545095:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545125:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545132:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545140:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545203:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545210:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c3a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545217:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545223:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209ae00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.545227:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545269:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545282:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.545285:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.545290:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545297:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545318:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545324:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545330:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545336:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.545339:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545346:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545354:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x839e9634 (ffff9747052c8f00) 00010000:00010000:3.0:1784938783.545356:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.545359:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545376:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545412:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07c33 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59f2 expref: 118 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545422:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.545424:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.545433:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07c33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59f2 expref: 118 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.545441:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209b200, rc 0) 00000100:00100000:3.0:1784938783.545517:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+117:25037:x1871643326083968:12345-192.168.202.4@tcp:101:cp.0 Request processed in 565us (839us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938783.545524:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:2.0:1784938783.555509:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.555594:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326084096 00000100:00100000:0.0:1784938783.555606:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326084096 00000100:00100000:0.0:1784938783.555679:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 126 00000100:00100000:0.0:1784938783.555691:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+117:25037:x1871643326084096:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.555715:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.555737:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07c48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d59f9 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.555836:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.555871:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.555887:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.555906:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250a00/0xcd9d312a94a07c56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.555913:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741250a00/0xcd9d312a94a07c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.555921:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250a00/0xcd9d312a94a07c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.555991:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556000:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556007:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556015:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.556019:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556028:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556041:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.556050:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.556057:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556064:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556079:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250a00/0xcd9d312a94a07c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556085:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741250a00/0xcd9d312a94a07c56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556092:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741250a00/0xcd9d312a94a07c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556097:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741250a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.556100:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250a00/0xcd9d312a94a07c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556106:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250a00/0xcd9d312a94a07c56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556114:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x839e9634 (ffff974705478600) 00010000:00010000:0.0:1784938783.556116:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.556119:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741250a00/0xcd9d312a94a07c56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556125:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250a00/0xcd9d312a94a07c56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556158:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07c48 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59f9 expref: 118 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556174:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.556176:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.556181:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07c48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59f9 expref: 118 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.556190:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251a00, rc 0) 00000100:00100000:0.0:1784938783.556255:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+117:25037:x1871643326084096:12345-192.168.202.4@tcp:101:cp.0 Request processed in 566us (755us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938783.556263:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 126 00000100:00100000:1.0:1784938783.563470:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.563564:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326084352 00000100:00100000:3.0:1784938783.563575:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326084352 00000100:00100000:3.0:1784938783.563636:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 127 00000100:00100000:3.0:1784938783.563647:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+117:25037:x1871643326084352:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.563670:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.563693:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07c5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a00 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.563864:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.563879:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.563891:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.563906:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x839e9634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.563912:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.563919:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938783.564449:0:33061:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13:0x0], index 1: 0 00010000:00010000:3.0:1784938783.564623:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209bc00/0xcd9d312a94a07c72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.564633:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209bc00/0xcd9d312a94a07c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.564642:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209bc00/0xcd9d312a94a07c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.564677:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.564684:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.564690:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.564696:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.564701:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.564709:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.564721:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.564724:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.564729:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.564747:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07c64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938783.564792:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000589f9a5e reply state 00000000e74a1f7b transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.564802:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938783.564833:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07c5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a00 expref: 120 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.564846:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209bc00/0xcd9d312a94a07c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a00 expref: 119 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.564854:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9747052c8200) 00010000:00010000:3.0:1784938783.564856:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938783.564859:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209bc00, rc 0) 00000100:00100000:3.0:1784938783.564934:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+120:25037:x1871643326084352:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1288us (1474us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1784938783.564943:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 127 00010000:00010000:2.0:1784938783.567570:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.567589:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.567597:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.567604:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209ae00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.567609:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.567617:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.567636:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x839e9634 (ffff9747052c8f00) 00010000:00010000:2.0:1784938783.567639:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.567644:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.567667:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07c6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x839e9634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.569222:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.569980:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326084480 00000100:00100000:0.0:1784938783.569994:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326084480 00000100:00100000:0.0:1784938783.570067:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:0.0:1784938783.570078:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+50:10024:x1871643326084480:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.570098:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.570119:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07c80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a07 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938783.570147:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938783.570169:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=937s v=(0 0) 00010000:00010000:0.0:1784938783.570174:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.570183:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07c80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a07 expref: 51 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.570200:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07c80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a07 expref: 51 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.570246:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251a00, rc 0) 00000100:00100000:0.0:1784938783.570332:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:10024:x1871643326084480:12345-192.168.202.4@tcp:101:cp.0 Request processed in 255us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938783.570339:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:1.0:1784938783.583994:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.584069:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326084608 00000100:00100000:0.0:1784938783.584078:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326084608 00000100:00100000:0.0:1784938783.584176:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:0.0:1784938783.584186:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:25037:x1871643326084608:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.584208:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.584229:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c61d0/0xcd9d312a94a07c87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a0e expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.584284:0:33065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07c80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a07 expref: 52 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.584294:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.584308:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.584312:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c61d0/0xcd9d312a94a07c87 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a0e expref: 52 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.584346:0:33065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07c80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a07 expref: 52 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.584359:0:33065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07c80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a07 expref: 52 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938783.584402:0:33065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342550912:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938783.584485:0:33065:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470507d900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938783.596635:0:33065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342550912:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938783.596675:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c61d0/0xcd9d312a94a07c87 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a0e expref: 52 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.596698:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250a00, rc 0) 00000100:00100000:0.0:1784938783.596823:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+52:25037:x1871643326084608:12345-192.168.202.4@tcp:101:cp.0 Request processed in 12637us (12835us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938783.596832:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:1.0:1784938783.606407:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.606856:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326084736 00000100:00100000:2.0:1784938783.606867:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326084736 00010000:00010000:2.0:1784938783.606910:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07c80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a07 expref: 52 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.606991:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:2.0:1784938783.607002:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+52:10024:x1871643326084736:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938783.607016:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938783.607039:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07c80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a07 expref: 52 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.607054:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07c80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a07 expref: 52 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.607077:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07c80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a07 expref: 52 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.607093:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.607098:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.607106:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c61d0/0xcd9d312a94a07c87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a0e expref: 51 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.607138:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c61d0/0xcd9d312a94a07c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a0e expref: 51 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.607174:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c61d0/0xcd9d312a94a07c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a0e expref: 51 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.607188:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703410e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342551040:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938783.607289:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938783.611830:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703410e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342551040:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938783.611928:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938783.612026:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:10024:x1871643326084736:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5024us (5628us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938783.612037:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:0.0:1784938783.612209:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.612273:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326084992 00000100:00100000:3.0:1784938783.612281:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326084992 00000100:00100000:3.0:1784938783.612330:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:3.0:1784938783.612339:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+119:25037:x1871643326084992:12345-192.168.202.4@tcp:35:cp.0 00000001:00080000:2.0:1784938783.616174:0:30634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:2.0:1784938783.616356:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+121:25037:x1871643326084992:12345-192.168.202.4@tcp:35:cp.0 Request processed in 4012us (4144us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1784938783.616631:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00000020:00080000:2.0:1784938783.616695:0:30634:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784938783.630918:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.630996:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326085120 00000100:00100000:0.0:1784938783.631008:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326085120 00000100:00100000:0.0:1784938783.631746:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 128 00000100:00100000:0.0:1784938783.631807:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+121:25037:x1871643326085120:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.631834:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.631860:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a07c8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a15 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.631941:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07c95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.631955:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07c95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.631986:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07c95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632003:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632010:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632017:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632109:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07c95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632117:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07c95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632123:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07c95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632130:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.632134:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07c95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632141:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07c95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632157:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.632160:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.632166:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07c95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632178:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07c95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632203:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632210:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632215:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632220:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.632223:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632240:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632250:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9e90f16b (ffff974705478100) 00010000:00010000:0.0:1784938783.632252:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.632256:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632262:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07c9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632298:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a07c8e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a15 expref: 122 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632321:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.632323:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.632328:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a07c8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a15 expref: 122 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.632337:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251200, rc 0) 00000100:00100000:0.0:1784938783.632429:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+121:25037:x1871643326085120:12345-192.168.202.4@tcp:101:cp.0 Request processed in 627us (1532us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938783.632436:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 128 00000100:00100000:1.0:1784938783.648658:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.648787:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326085248 00000100:00100000:3.0:1784938783.648797:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326085248 00000100:00100000:3.0:1784938783.648853:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 129 00000100:00100000:3.0:1784938783.648863:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+121:25037:x1871643326085248:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.648898:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.648927:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07ca3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a1c expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649006:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07caa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649023:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07caa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649034:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07caa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649046:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07cb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649053:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649060:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649123:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07caa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649130:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07caa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649136:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07caa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649142:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.649151:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07caa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649160:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07caa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649173:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.649176:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.649180:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07caa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649187:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07caa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649200:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649205:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07cb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649211:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649217:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.649220:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649225:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649241:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9e90f16b (ffff9747052c8f00) 00010000:00010000:3.0:1784938783.649244:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.649252:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07cb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649258:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07cb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649288:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07ca3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a1c expref: 122 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649306:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.649308:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.649312:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b200/0xcd9d312a94a07ca3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a1c expref: 122 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.649321:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209b200, rc 0) 00000100:00100000:3.0:1784938783.649379:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+121:25037:x1871643326085248:12345-192.168.202.4@tcp:101:cp.0 Request processed in 517us (732us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938783.649386:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 129 00000100:00100000:1.0:1784938783.657348:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.657991:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326085504 00000100:00100000:2.0:1784938783.658005:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326085504 00000100:00100000:2.0:1784938783.658072:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 130 00000100:00100000:2.0:1784938783.658082:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+121:25037:x1871643326085504:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938783.658111:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938783.658131:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07cb8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a23 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.658287:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07cbf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.658302:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07cbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.658313:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07cbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.658325:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07cc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.658331:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.658337:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938783.662711:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14:0x0], index 0: 0 00010000:00010000:2.0:1784938783.662955:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a07ccd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.662976:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a07ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.662990:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a07ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.663035:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07cbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.663078:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07cbf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.663085:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07cbf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.663091:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.663096:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07cbf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.663104:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07cbf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.663118:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.663121:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.663126:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07cbf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.663132:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07cbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938783.663147:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005da1d44e reply state 0000000087beff6e transno 4294967373 ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.663156:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938783.663209:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07cb8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a23 expref: 124 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.663224:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a07ccd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a23 expref: 123 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.663255:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff97473e984700) 00010000:00010000:2.0:1784938783.663257:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938783.663260:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05800, rc 0) 00000100:00100000:2.0:1784938783.663349:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+124:25037:x1871643326085504:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5267us (6013us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1784938783.663358:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 130 00000100:00100000:1.0:1784938783.671339:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1784938783.671433:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.671448:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07cc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.671456:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07cc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.671463:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.671468:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07cc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.671476:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07cc6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.671494:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9e90f16b (ffff97473e984d00) 00010000:00010000:0.0:1784938783.671497:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.671501:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07cc6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.671523:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07cc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9e90f16b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.677683:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326085632 00000100:00100000:2.0:1784938783.677700:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326085632 00000100:00100000:2.0:1784938783.677791:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:2.0:1784938783.677803:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+23:10025:x1871643326085632:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938783.677822:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938783.677844:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07cdb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a2a expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938783.677873:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938783.677893:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=937s v=(0 0) 00010000:00010000:2.0:1784938783.677898:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.677907:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07cdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a2a expref: 24 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.677924:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07cdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a2a expref: 24 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.677936:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05400, rc 0) 00000100:00100000:2.0:1784938783.678010:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+24:10025:x1871643326085632:12345-192.168.202.4@tcp:101:cp.0 Request processed in 209us (6683us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938783.678034:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:1.0:1784938783.683484:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.683633:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326085760 00000100:00100000:3.0:1784938783.683643:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326085760 00000100:00100000:3.0:1784938783.683738:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:3.0:1784938783.683748:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+24:25037:x1871643326085760:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.683793:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.683813:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001760d2e/0xcd9d312a94a07ce2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a31 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.683844:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07cdb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a2a expref: 25 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.683872:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.683876:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.683883:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001760d2e/0xcd9d312a94a07ce2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a31 expref: 25 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.683920:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07cdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a2a expref: 25 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.683936:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07cdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a2a expref: 25 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.683951:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342551168:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938783.684039:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460262bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938783.693479:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342551168:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938783.693516:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001760d2e/0xcd9d312a94a07ce2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a31 expref: 25 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.693538:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209b200, rc 0) 00000100:00100000:3.0:1784938783.693598:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:25037:x1871643326085760:12345-192.168.202.4@tcp:101:cp.0 Request processed in 9851us (10122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938783.693607:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:1.0:1784938783.696462:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.697141:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326085888 00000100:00100000:2.0:1784938783.697152:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326085888 00010000:00010000:2.0:1784938783.697194:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07cdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a2a expref: 25 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.697280:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:2.0:1784938783.697290:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:10026:x1871643326085888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938783.697318:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938783.697344:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07cdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a2a expref: 25 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.697360:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07cdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a2a expref: 25 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.697384:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07cdb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a2a expref: 25 pid: 31427 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.697402:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.697407:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.697415:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001760d2e/0xcd9d312a94a07ce2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a31 expref: 24 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.697425:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001760d2e/0xcd9d312a94a07ce2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a31 expref: 24 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.697491:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000001760d2e/0xcd9d312a94a07ce2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a31 expref: 24 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.697505:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703410e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342551296:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938783.697595:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938783.718503:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.718601:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326086144 00000100:00100000:0.0:1784938783.718612:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326086144 00000100:00100000:0.0:1784938783.718681:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:0.0:1784938783.718692:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+123:25037:x1871643326086144:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938783.719098:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+124:25037:x1871643326086144:12345-192.168.202.4@tcp:35:cp.0 Request processed in 407us (606us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1784938783.719107:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:2.0:1784938783.719540:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703410e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342551296:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938783.719590:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938783.719626:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+24:10026:x1871643326085888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 22337us (23176us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938783.719636:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:1.0:1784938783.723711:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.723853:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326086272 00000100:00100000:0.0:1784938783.723866:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326086272 00000100:00100000:0.0:1784938783.723931:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 131 00000100:00100000:0.0:1784938783.723943:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+124:25037:x1871643326086272:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.723972:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.723999:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07ce9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a38 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724102:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07cf0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724117:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07cf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724130:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07cf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724144:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07cf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724158:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724166:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724248:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07cf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724257:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07cf0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724263:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07cf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724270:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.724274:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07cf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724282:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07cf0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724418:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.724421:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.724428:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07cf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724436:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07cf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724451:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724465:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07cf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724471:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724475:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741250600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.724478:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724485:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07cf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724494:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x10fe8da8 (ffff974705478100) 00010000:00010000:0.0:1784938783.724497:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.724499:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07cf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724505:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07cf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724539:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07ce9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a38 expref: 125 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724548:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.724550:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.724554:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251a00/0xcd9d312a94a07ce9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a38 expref: 125 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.724574:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251a00, rc 0) 00000100:00100000:0.0:1784938783.724644:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+124:25037:x1871643326086272:12345-192.168.202.4@tcp:101:cp.0 Request processed in 703us (945us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938783.724651:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 131 00000100:00100000:0.0:1784938783.734318:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.734450:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326086400 00000100:00100000:2.0:1784938783.734460:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326086400 00000100:00100000:2.0:1784938783.734521:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 132 00000100:00100000:2.0:1784938783.734531:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+124:25037:x1871643326086400:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938783.734551:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938783.734574:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07cfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a3f expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734651:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734666:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734676:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734701:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07d0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734706:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734710:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734781:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734786:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734790:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734793:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.734796:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734801:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734808:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.734810:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.734813:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734817:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734830:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734833:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07d0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734837:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07d0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734839:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.734841:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07d0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734844:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07d0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734848:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x10fe8da8 (ffff97473e984a00) 00010000:00010000:2.0:1784938783.734850:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.734851:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07d0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734854:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07d0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734880:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07cfe lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a3f expref: 125 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734889:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.734891:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.734902:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07cfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a3f expref: 125 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.734911:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05400, rc 0) 00000100:00100000:2.0:1784938783.734969:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+124:25037:x1871643326086400:12345-192.168.202.4@tcp:101:cp.0 Request processed in 440us (660us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938783.734974:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 132 00000100:00100000:3.0:1784938783.747537:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.747652:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326086656 00000100:00100000:1.0:1784938783.747677:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326086656 00000100:00100000:1.0:1784938783.747746:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 133 00000100:00100000:1.0:1784938783.747793:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+124:25037:x1871643326086656:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.747816:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.747841:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07d13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a46 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.747969:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07d1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.747983:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07d1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.747994:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07d1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748007:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07d21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748012:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07d21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748018:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07d21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938783.748509:0:33061:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14:0x0], index 1: 0 00010000:00010000:1.0:1784938783.748669:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07d28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748680:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07d28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748698:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07d28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748734:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07d1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748741:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07d1a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748746:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07d1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748781:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938783.748786:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07d1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748793:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07d1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748806:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938783.748809:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938783.748814:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07d1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748821:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07d1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938783.748833:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de4d7236 reply state 000000008ba90a4c transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07d21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.748841:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938783.748875:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07d13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a46 expref: 127 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748889:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07d28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a46 expref: 126 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.748896:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff97473a027a00) 00010000:00010000:1.0:1784938783.748898:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938783.748901:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569e00, rc 0) 00000100:00100000:1.0:1784938783.748958:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+127:25037:x1871643326086656:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1169us (1432us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1784938783.748964:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 133 00010000:00010000:2.0:1784938783.751239:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07d21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.751257:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07d21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.751264:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07d21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.751270:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.751275:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07d21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.751283:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07d21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.751298:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x10fe8da8 (ffff97473a027300) 00010000:00010000:2.0:1784938783.751302:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.751306:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07d21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.751313:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07d21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x10fe8da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.753126:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.753227:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326086784 00000100:00100000:1.0:1784938783.753247:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326086784 00000100:00100000:1.0:1784938783.753305:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:1.0:1784938783.753315:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:10023:x1871643326086784:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.753334:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.753357:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07d36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a4d expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938783.753385:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938783.753405:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=937s v=(0 0) 00010000:00010000:1.0:1784938783.753410:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938783.753420:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07d36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a4d expref: 52 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.753437:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07d36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a4d expref: 52 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.753465:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569c00, rc 0) 00000100:00100000:1.0:1784938783.753581:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+52:10023:x1871643326086784:12345-192.168.202.4@tcp:101:cp.0 Request processed in 267us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938783.753588:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:1.0:1784938783.756807:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.756892:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326086912 00000100:00100000:0.0:1784938783.756902:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326086912 00000100:00100000:0.0:1784938783.756958:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:0.0:1784938783.756968:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+52:25037:x1871643326086912:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.756986:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.757005:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07d3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a54 expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.757037:0:33065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07d36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a4d expref: 53 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.757059:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.757064:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.757070:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07d3d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a54 expref: 53 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.757104:0:33065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07d36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a4d expref: 53 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.757120:0:33065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07d36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a4d expref: 53 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938783.757160:0:33065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342551424:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938783.757264:0:33065:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470507d900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938783.760940:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.761036:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326087040 00000100:00100000:2.0:1784938783.761045:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326087040 00010000:00010000:2.0:1784938783.761094:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07d36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a4d expref: 54 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.761126:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:2.0:1784938783.761136:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974702b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:10023:x1871643326087040:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938783.761161:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938783.761195:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07d36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a4d expref: 54 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.761210:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07d36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a4d expref: 54 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.761245:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.761258:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.761267:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07d3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a54 expref: 54 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.761277:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07d3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a54 expref: 54 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.761319:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07d3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a54 expref: 54 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.761360:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703410e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342551552:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938783.761455:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938783.765001:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703410e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342551552:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938783.765029:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938783.765086:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974702b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:10023:x1871643326087040:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3951us (4155us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938783.765097:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 53 00010000:00010000:0.0:1784938783.767162:0:33065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cf41fdd/0xcd9d312a94a07d36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a4d expref: 53 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938783.767197:0:33065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342551424:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938783.767239:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07d3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a54 expref: 52 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.767255:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251a00, rc 0) 00000100:00100000:0.0:1784938783.767314:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+52:25037:x1871643326086912:12345-192.168.202.4@tcp:101:cp.0 Request processed in 10346us (10515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938783.767322:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:1.0:1784938783.785352:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.785449:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326087296 00000100:00100000:0.0:1784938783.785459:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326087296 00000100:00100000:0.0:1784938783.785521:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:0.0:1784938783.785532:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+126:25037:x1871643326087296:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938783.785893:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+127:25037:x1871643326087296:12345-192.168.202.4@tcp:35:cp.0 Request processed in 362us (553us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1784938783.785901:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:1.0:1784938783.797253:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.797492:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326087424 00000100:00100000:2.0:1784938783.797503:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326087424 00000100:00100000:2.0:1784938783.797621:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 134 00000100:00100000:2.0:1784938783.797632:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+127:25037:x1871643326087424:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938783.797656:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938783.797679:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07d44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a5b expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797771:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797786:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797796:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797811:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07d52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797838:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07d52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797847:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07d52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797908:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797916:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797923:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797930:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.797934:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797941:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797953:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.797957:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.797961:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797968:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04c00/0xcd9d312a94a07d4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797980:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07d52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797993:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07d52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.797999:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07d52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.798004:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.798007:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07d52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.798014:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07d52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.798021:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x6b7bd7c (ffff97473e984a00) 00010000:00010000:2.0:1784938783.798024:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.798027:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07d52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.798034:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07d52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.798067:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07d44 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a5b expref: 128 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.798077:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.798079:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.798083:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07d44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a5b expref: 128 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.798104:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04800, rc 0) 00000100:00100000:2.0:1784938783.798175:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+127:25037:x1871643326087424:12345-192.168.202.4@tcp:101:cp.0 Request processed in 545us (943us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938783.798192:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 134 00000100:00100000:1.0:1784938783.804148:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.804296:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326087552 00000100:00100000:3.0:1784938783.804320:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326087552 00000100:00100000:3.0:1784938783.804428:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 135 00000100:00100000:3.0:1784938783.804439:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+127:25037:x1871643326087552:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.804463:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.804485:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07d59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a62 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804551:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07d60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804566:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804576:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804590:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07d67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804598:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804605:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804671:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804679:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07d60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804685:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07d60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804711:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.804716:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07d60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804724:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07d60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804736:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.804739:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.804744:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07d60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804779:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07d60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804793:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804799:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07d67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804805:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804811:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209b800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.804814:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804820:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07d67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804840:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x6b7bd7c (ffff9747052c8f00) 00010000:00010000:3.0:1784938783.804842:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.804846:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07d67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804851:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07d67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804887:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07d59 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a62 expref: 128 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804898:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.804901:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.804904:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07d59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a62 expref: 128 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.804914:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209a800, rc 0) 00000100:00100000:3.0:1784938783.804987:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+127:25037:x1871643326087552:12345-192.168.202.4@tcp:101:cp.0 Request processed in 549us (852us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938783.804994:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 135 00000100:00100000:0.0:1784938783.815199:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.815346:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326087808 00000100:00100000:3.0:1784938783.815359:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326087808 00000100:00100000:3.0:1784938783.815426:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 136 00000100:00100000:3.0:1784938783.815436:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+127:25037:x1871643326087808:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.815457:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.815481:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b400/0xcd9d312a94a07d6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a69 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.815648:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07d75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.815664:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07d75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.815675:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07d75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.815691:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07d7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.815712:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.815719:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938783.816545:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15:0x0], index 0: 0 00010000:00010000:3.0:1784938783.816710:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07d83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.816721:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.816729:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.816787:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07d75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.816805:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07d75 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.816811:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07d75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.816817:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209aa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.816821:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07d75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.816829:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07d75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.816843:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.816845:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.816850:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07d75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.816856:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07d75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938783.816870:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004ea88f2f reply state 0000000060a3dbb2 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.816879:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938783.816909:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b400/0xcd9d312a94a07d6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a69 expref: 130 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.816923:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a69 expref: 129 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.816941:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff97471360e300) 00010000:00010000:3.0:1784938783.816944:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938783.816946:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209a600, rc 0) 00000100:00100000:3.0:1784938783.817011:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+130:25037:x1871643326087808:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1575us (1831us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1784938783.817019:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 136 00010000:00010000:0.0:1784938783.821195:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.821247:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07d7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.821256:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07d7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.821263:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209b600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.821268:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07d7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.821277:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07d7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.821295:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x6b7bd7c (ffff9747052c8100) 00010000:00010000:0.0:1784938783.821298:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.821303:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07d7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.821309:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07d7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x6b7bd7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938783.830318:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938783.830491:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326087936 00000100:00100000:1.0:1784938783.830500:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326087936 00000100:00100000:1.0:1784938783.830560:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:1.0:1784938783.830570:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+24:10025:x1871643326087936:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938783.830590:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938783.830612:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a07d91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a70 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938783.830639:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938783.830658:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=937s v=(0 0) 00010000:00010000:1.0:1784938783.830663:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938783.830673:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a07d91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a70 expref: 25 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.830690:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a07d91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a70 expref: 25 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938783.830743:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568600, rc 0) 00000100:00100000:1.0:1784938783.830854:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:10025:x1871643326087936:12345-192.168.202.4@tcp:101:cp.0 Request processed in 285us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938783.830862:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:1.0:1784938783.836214:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.836285:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326088064 00000100:00100000:3.0:1784938783.836307:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326088064 00000100:00100000:3.0:1784938783.836371:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:3.0:1784938783.836383:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:25037:x1871643326088064:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.836403:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.836426:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9471409/0xcd9d312a94a07d98 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a77 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.836461:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a07d91 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a70 expref: 26 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.836471:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.836476:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.836482:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9471409/0xcd9d312a94a07d98 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a77 expref: 26 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.836526:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a07d91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a70 expref: 26 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.836576:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a07d91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a70 expref: 26 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938783.836591:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342551680:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938783.836702:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460262bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938783.846590:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342551680:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938783.846629:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9471409/0xcd9d312a94a07d98 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a77 expref: 26 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.846654:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209b400, rc 0) 00000100:00100000:2.0:1784938783.846732:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:25037:x1871643326088064:12345-192.168.202.4@tcp:101:cp.0 Request processed in 10351us (10528us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938783.846741:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:0.0:1784938783.847855:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.847932:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326088192 00000100:00100000:2.0:1784938783.847941:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326088192 00010000:00010000:2.0:1784938783.847978:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a07d91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a70 expref: 26 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.848016:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:2.0:1784938783.848026:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:10026:x1871643326088192:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938783.848041:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938783.848077:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a07d91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a70 expref: 26 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.848092:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a07d91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a70 expref: 26 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.848135:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6811963/0xcd9d312a94a07d91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a70 expref: 26 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.848164:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.848168:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.848178:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9471409/0xcd9d312a94a07d98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a77 expref: 25 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.848197:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9471409/0xcd9d312a94a07d98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a77 expref: 25 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.848266:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e9471409/0xcd9d312a94a07d98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a77 expref: 25 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.848281:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703410380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342551808:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938783.848364:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938783.861572:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.861680:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703410380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342551808:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938783.861711:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938783.861793:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:10026:x1871643326088192:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 13768us (13943us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938783.861805:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:3.0:1784938783.861880:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326088448 00000100:00100000:3.0:1784938783.861887:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326088448 00000100:00100000:3.0:1784938783.861925:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:3.0:1784938783.861932:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705cdb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+129:25037:x1871643326088448:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938783.862290:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705cdb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+130:25037:x1871643326088448:12345-192.168.202.4@tcp:35:cp.0 Request processed in 357us (727us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1784938783.862298:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:3.0:1784938783.870278:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.870400:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326088576 00000100:00100000:0.0:1784938783.870410:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326088576 00000100:00100000:0.0:1784938783.870471:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 137 00000100:00100000:0.0:1784938783.870481:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+130:25037:x1871643326088576:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.870506:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.870530:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07d9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a7e expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870620:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07da6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870635:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07da6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870647:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07da6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870664:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870671:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870677:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870744:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07da6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870794:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07da6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870802:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870808:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.870813:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870832:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07da6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870845:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.870848:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.870853:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07da6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870859:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07da6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870872:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870877:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870882:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870887:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741250e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.870890:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870895:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870900:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x37dcc2d3 (ffff974705478100) 00010000:00010000:0.0:1784938783.870903:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.870905:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870920:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870955:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07d9f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a7e expref: 131 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870966:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.870968:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.870971:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07d9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a7e expref: 131 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.870981:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250800, rc 0) 00000100:00100000:0.0:1784938783.871033:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+130:25037:x1871643326088576:12345-192.168.202.4@tcp:101:cp.0 Request processed in 553us (762us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938783.871039:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 137 00000100:00100000:0.0:1784938783.878010:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.878358:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326088704 00000100:00100000:3.0:1784938783.878369:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326088704 00000100:00100000:3.0:1784938783.878458:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 138 00000100:00100000:3.0:1784938783.878468:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+130:25037:x1871643326088704:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.878487:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.878507:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07db4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a85 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878568:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07dbb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878583:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07dbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878613:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07dbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878631:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07dc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878639:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878646:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878716:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07dbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878723:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07dbb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878730:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07dbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878735:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.878739:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07dbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878746:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07dbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878795:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.878798:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.878802:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07dbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878815:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07dbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878829:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878835:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07dc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878842:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878847:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209b800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.878850:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878855:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07dc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878862:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x37dcc2d3 (ffff97471360e900) 00010000:00010000:3.0:1784938783.878864:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.878866:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07dc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878872:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07dc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878901:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07db4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a85 expref: 131 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878921:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.878923:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.878927:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07db4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a85 expref: 131 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.878937:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209aa00, rc 0) 00000100:00100000:3.0:1784938783.878989:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+130:25037:x1871643326088704:12345-192.168.202.4@tcp:101:cp.0 Request processed in 522us (993us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938783.878996:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 138 00000100:00100000:1.0:1784938783.897426:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.897565:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326088960 00000100:00100000:0.0:1784938783.897575:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326088960 00000100:00100000:0.0:1784938783.897692:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 139 00000100:00100000:0.0:1784938783.897702:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+130:25037:x1871643326088960:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.897723:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.897745:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07dc9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a8c expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.897939:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.897975:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.897988:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.898004:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07dd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.898011:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.898018:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938783.898581:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15:0x0], index 1: 0 00010000:00010000:0.0:1784938783.898808:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07dde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.898820:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.898828:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.898864:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.898872:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dd0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.898878:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.898891:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741250e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.898896:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.898903:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dd0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.898915:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.898918:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.898923:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dd0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.898929:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938783.898943:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f7d9ec3 reply state 0000000000182dc5 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938783.898953:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938783.898982:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250800/0xcd9d312a94a07dc9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a8c expref: 133 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.898997:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07dde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a8c expref: 132 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.899005:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff974705478200) 00010000:00010000:0.0:1784938783.899007:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938783.899010:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251400, rc 0) 00000100:00100000:0.0:1784938783.899081:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+133:25037:x1871643326088960:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1379us (1664us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1784938783.899096:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 139 00010000:00010000:2.0:1784938783.903439:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.903458:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07dd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.903481:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.903486:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.903489:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.903495:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07dd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.903507:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x37dcc2d3 (ffff974705478100) 00010000:00010000:2.0:1784938783.903509:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.903512:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07dd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.903517:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07dd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x37dcc2d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.909629:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.909910:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326089088 00000100:00100000:3.0:1784938783.909921:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326089088 00000100:00100000:3.0:1784938783.909982:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00100000:3.0:1784938783.909992:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+52:10023:x1871643326089088:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.910011:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.910034:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051cbfa21/0xcd9d312a94a07dec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a93 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938783.910057:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938783.910074:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=937s v=(0 0) 00010000:00010000:3.0:1784938783.910077:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.910084:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051cbfa21/0xcd9d312a94a07dec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a93 expref: 53 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.910096:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051cbfa21/0xcd9d312a94a07dec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a93 expref: 53 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.910123:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209aa00, rc 0) 00000100:00100000:3.0:1784938783.910271:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+53:10023:x1871643326089088:12345-192.168.202.4@tcp:101:cp.0 Request processed in 191us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938783.910279:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00100000:1.0:1784938783.916284:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.916619:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326089216 00000100:00100000:0.0:1784938783.916630:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326089216 00000100:00100000:0.0:1784938783.916691:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:0.0:1784938783.916702:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+53:25037:x1871643326089216:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.916723:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.916743:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab105ca9/0xcd9d312a94a07df3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5a9a expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.916828:0:33065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051cbfa21/0xcd9d312a94a07dec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a93 expref: 54 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.916838:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.916843:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938783.916848:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab105ca9/0xcd9d312a94a07df3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a9a expref: 54 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.916883:0:33065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051cbfa21/0xcd9d312a94a07dec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a93 expref: 54 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.916897:0:33065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051cbfa21/0xcd9d312a94a07dec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a93 expref: 54 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938783.916911:0:33065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342551936:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938783.916986:0:33065:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470507d600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938783.920002:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.920088:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326089344 00000100:00100000:2.0:1784938783.920097:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326089344 00010000:00010000:2.0:1784938783.920132:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051cbfa21/0xcd9d312a94a07dec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a93 expref: 55 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.920173:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:0.0:1784938783.920329:0:33065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342551936:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938783.920360:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ab105ca9/0xcd9d312a94a07df3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->114687] (req 0->114687) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a9a expref: 55 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.920390:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250800, rc 0) 00000100:00100000:2.0:1784938783.920427:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:10023:x1871643326089344:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938783.920444:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784938783.920451:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:25037:x1871643326089216:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3752us (4178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938783.920458:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 91 00010000:00010000:2.0:1784938783.920470:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051cbfa21/0xcd9d312a94a07dec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a93 expref: 55 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.920506:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051cbfa21/0xcd9d312a94a07dec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a93 expref: 54 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.920532:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051cbfa21/0xcd9d312a94a07dec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a93 expref: 54 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.920546:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.920551:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.920559:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab105ca9/0xcd9d312a94a07df3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a9a expref: 53 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.920570:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab105ca9/0xcd9d312a94a07df3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a9a expref: 53 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.920603:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ab105ca9/0xcd9d312a94a07df3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a9a expref: 53 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.920617:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703410380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342552064:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938783.922527:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938783.926680:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703410380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342552064:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938783.926709:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938783.926864:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+53:10023:x1871643326089344:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6681us (6869us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938783.926875:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:1.0:1784938783.934432:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.934587:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326089600 00000100:00100000:3.0:1784938783.934599:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326089600 00000100:00100000:3.0:1784938783.934662:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:3.0:1784938783.934673:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+132:25037:x1871643326089600:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938783.935084:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+133:25037:x1871643326089600:12345-192.168.202.4@tcp:35:cp.0 Request processed in 412us (662us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1784938783.935092:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:1.0:1784938783.939434:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938783.939680:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326089728 00000100:00100000:0.0:1784938783.939692:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326089728 00000100:00100000:0.0:1784938783.939927:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 140 00000100:00100000:0.0:1784938783.939939:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+133:25037:x1871643326089728:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938783.939965:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938783.939988:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5aa1 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940058:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940072:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940084:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940100:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940106:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940129:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940193:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940200:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940207:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940213:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741250600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.940218:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940225:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940253:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.940256:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.940260:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940267:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940280:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940286:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940309:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940314:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.940317:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940324:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940332:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa4bfea24 (ffff974705478900) 00010000:00010000:0.0:1784938783.940335:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.940338:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940344:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940379:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dfa lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5aa1 expref: 134 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940389:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938783.940392:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.940396:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07dfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5aa1 expref: 134 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.940405:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250e00, rc 0) 00000100:00100000:0.0:1784938783.940472:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+133:25037:x1871643326089728:12345-192.168.202.4@tcp:101:cp.0 Request processed in 535us (1050us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938783.940489:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 140 00000100:00100000:2.0:1784938783.944189:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.944285:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326089856 00000100:00100000:3.0:1784938783.944304:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326089856 00000100:00100000:3.0:1784938783.944362:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 141 00000100:00100000:3.0:1784938783.944372:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+133:25037:x1871643326089856:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.944393:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.944414:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07e0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5aa8 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944480:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07e16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944495:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07e16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944505:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07e16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944537:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07e1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944546:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944554:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944619:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07e16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944627:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07e16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944634:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07e16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944640:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.944645:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07e16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944652:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07e16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944664:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.944667:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.944671:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07e16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944678:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a07e16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944699:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944704:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07e1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944710:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07e1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944715:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938783.944717:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07e1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944724:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07e1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944732:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa4bfea24 (ffff97471360ef00) 00010000:00010000:3.0:1784938783.944734:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.944737:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07e1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944743:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a000/0xcd9d312a94a07e1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.944991:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07e0f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5aa8 expref: 134 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.945001:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938783.945004:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938783.945015:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a07e0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5aa8 expref: 134 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.945025:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209b800, rc 0) 00000100:00100000:2.0:1784938783.949003:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+133:25037:x1871643326089856:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4620us (4812us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938783.949018:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 141 00000100:00100000:1.0:1784938783.954943:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.954984:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326090112 00000100:00100000:3.0:1784938783.954993:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326090112 00000100:00100000:3.0:1784938783.955067:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 142 00000100:00100000:3.0:1784938783.955078:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+133:25037:x1871643326090112:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.955099:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.955122:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07e24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5aaf expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.955504:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07e2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.955520:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07e2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.955531:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07e2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.955545:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07e32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.955552:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.955558:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938783.956205:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16:0x0], index 0: 0 00010000:00010000:2.0:1784938783.956391:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07e39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.956403:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.956411:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.956447:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07e2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.956454:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07e2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.956460:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07e2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.956466:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209b600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938783.956470:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07e2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.956477:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07e2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.956488:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938783.956491:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938783.956504:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07e2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.956511:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a07e2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938783.956525:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ebe292c reply state 00000000be07f9d7 transno 4294967381 ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.956533:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938783.956566:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a07e24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5aaf expref: 136 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.956580:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5aaf expref: 135 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.956587:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff97473e984a00) 00010000:00010000:2.0:1784938783.956589:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938783.956591:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04400, rc 0) 00000100:00100000:2.0:1784938783.956699:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+136:25037:x1871643326090112:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1622us (1763us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1784938783.956707:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 142 00010000:00010000:0.0:1784938783.963320:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.963341:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07e32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.963350:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07e32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.963356:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209ae00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938783.963361:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07e32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.963370:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07e32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.963388:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa4bfea24 (ffff97471360ec00) 00010000:00010000:0.0:1784938783.963391:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938783.963396:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07e32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938783.963402:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a07e32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xa4bfea24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938783.971031:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938783.971311:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326090240 00000100:00100000:3.0:1784938783.971335:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326090240 00000100:00100000:3.0:1784938783.971399:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:3.0:1784938783.971409:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+25:10025:x1871643326090240:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938783.971427:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938783.971446:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a07e47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ab6 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938783.971471:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938783.971491:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=937s v=(0 0) 00010000:00010000:3.0:1784938783.971496:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938783.971505:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a07e47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ab6 expref: 26 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.971522:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a07e47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ab6 expref: 26 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938783.971535:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209b800, rc 0) 00000100:00100000:3.0:1784938783.971597:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:10025:x1871643326090240:12345-192.168.202.4@tcp:101:cp.0 Request processed in 189us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938783.971604:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:1.0:1784938783.982036:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.982286:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326090368 00000100:00100000:2.0:1784938783.982295:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326090368 00000100:00100000:2.0:1784938783.982351:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 93 00000100:00100000:2.0:1784938783.982362:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:25037:x1871643326090368:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938783.982381:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938783.982402:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a07e4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5abd expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.982451:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a07e47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ab6 expref: 27 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.982460:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.982464:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.982470:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a07e4e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->36863] (req 0->36863) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5abd expref: 27 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.982503:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a07e47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ab6 expref: 27 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.982518:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a07e47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ab6 expref: 27 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.982533:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703410e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342552192:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938783.982834:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938783.985446:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703410e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342552192:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938783.985480:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a07e4e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->36863] (req 0->36863) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5abd expref: 27 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.985501:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04c00, rc 0) 00000100:00100000:2.0:1784938783.985600:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:25037:x1871643326090368:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3238us (3573us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938783.985609:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 93 00000100:00100000:3.0:1784938783.986590:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938783.986641:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326090496 00000100:00100000:2.0:1784938783.986649:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326090496 00010000:00010000:2.0:1784938783.986924:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a07e47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ab6 expref: 27 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.986960:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:2.0:1784938783.986970:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:10026:x1871643326090496:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938783.986983:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938783.987004:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a07e47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ab6 expref: 27 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.987016:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a07e47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ab6 expref: 27 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.987040:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a07e47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ab6 expref: 27 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.987055:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.987059:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938783.987067:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a07e4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5abd expref: 26 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.987076:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a07e4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5abd expref: 26 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938783.987108:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a07e4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5abd expref: 26 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938783.987130:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703410e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342552320:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938783.987337:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938783.991881:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703410e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342552320:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938783.991907:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938783.991963:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:10026:x1871643326090496:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4994us (5377us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938783.991974:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:1.0:1784938784.000724:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.000893:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326090752 00000100:00100000:3.0:1784938784.000903:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326090752 00000100:00100000:3.0:1784938784.000966:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:3.0:1784938784.000976:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+135:25037:x1871643326090752:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938784.001903:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+136:25037:x1871643326090752:12345-192.168.202.4@tcp:35:cp.0 Request processed in 925us (1186us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1784938784.001925:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00080000:0.0:1784938784.002013:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938784.006679:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.006944:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326090880 00000100:00100000:0.0:1784938784.006954:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326090880 00000100:00100000:0.0:1784938784.007027:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 143 00000100:00100000:0.0:1784938784.007038:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+136:25037:x1871643326090880:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.007079:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.007100:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07e55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ac4 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007166:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007181:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007192:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007206:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007213:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007220:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007475:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007483:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007488:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007493:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.007504:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007512:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007524:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.007527:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.007531:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007538:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07e5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007611:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007617:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007622:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007625:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741250600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.007627:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007632:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007638:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc2bba7e5 (ffff974705478900) 00010000:00010000:0.0:1784938784.007640:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.007650:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007656:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07e63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007692:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07e55 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ac4 expref: 137 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007701:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.007704:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.007708:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07e55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ac4 expref: 137 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.007717:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250e00, rc 0) 00000100:00100000:0.0:1784938784.007822:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+136:25037:x1871643326090880:12345-192.168.202.4@tcp:101:cp.0 Request processed in 786us (1153us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.007828:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 143 00000100:00100000:1.0:1784938784.011462:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.011539:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326091008 00000100:00100000:0.0:1784938784.011629:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326091008 00000100:00100000:0.0:1784938784.011696:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 144 00000100:00100000:0.0:1784938784.011707:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+136:25037:x1871643326091008:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.011728:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.011771:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a07e6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5acb expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.011838:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07e71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.011872:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07e71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.011885:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07e71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.011901:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a07e78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.011920:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a07e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.011927:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a07e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.011992:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07e71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012000:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07e71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012007:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07e71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012014:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.012018:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07e71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012036:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07e71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012049:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.012058:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.012064:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07e71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012071:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07e71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012086:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a07e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012092:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a07e78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012099:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a07e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012104:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.012107:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a07e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012114:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a07e78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012121:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc2bba7e5 (ffff974705478d00) 00010000:00010000:0.0:1784938784.012124:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.012127:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a07e78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012133:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609397400/0xcd9d312a94a07e78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012165:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a07e6a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5acb expref: 137 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012181:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.012183:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.012188:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a07e6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5acb expref: 137 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.012197:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251200, rc 0) 00000100:00100000:0.0:1784938784.012280:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+136:25037:x1871643326091008:12345-192.168.202.4@tcp:101:cp.0 Request processed in 574us (828us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.012287:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 144 00000100:00100000:1.0:1784938784.015945:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.016038:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326091264 00000100:00100000:2.0:1784938784.016048:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326091264 00000100:00100000:2.0:1784938784.016100:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 145 00000100:00100000:2.0:1784938784.016110:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+136:25037:x1871643326091264:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.016135:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.016164:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07e7f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ad2 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.016465:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07e86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.016480:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07e86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.016492:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07e86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.016507:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07e8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.016526:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.016533:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938784.018490:0:33061:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16:0x0], index 1: 0 00010000:00010000:2.0:1784938784.018788:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07e94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.018807:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.018820:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.018857:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07e86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.018866:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07e86 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.018872:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07e86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.018878:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.018883:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07e86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.018891:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07e86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.018930:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.018933:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.018939:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07e86 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.018946:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07e86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938784.018959:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009fdc7c95 reply state 000000007df8b205 transno 4294967383 ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.018968:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938784.019006:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07e7f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ad2 expref: 139 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.019020:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07e94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ad2 expref: 138 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.019412:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff97473e984100) 00010000:00010000:2.0:1784938784.019415:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938784.019418:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05200, rc 0) 00000100:00100000:2.0:1784938784.019504:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+139:25037:x1871643326091264:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3395us (3570us total) trans 4294967383 rc 0/0 00000100:00100000:2.0:1784938784.019514:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 145 00010000:00010000:2.0:1784938784.023926:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.023943:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07e8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.023968:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07e8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.023975:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.023980:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07e8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.023988:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07e8d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.024005:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc2bba7e5 (ffff97473e984500) 00010000:00010000:2.0:1784938784.024008:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.024013:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07e8d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.024020:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07e8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc2bba7e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938784.030200:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.030500:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326091392 00000100:00100000:3.0:1784938784.030512:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326091392 00000100:00100000:3.0:1784938784.030576:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 94 00000100:00100000:3.0:1784938784.030586:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+53:10023:x1871643326091392:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.030605:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938784.030628:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a07ea2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ad9 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938784.030657:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938784.030678:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=937s v=(0 0) 00010000:00010000:3.0:1784938784.030683:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.030693:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a07ea2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ad9 expref: 54 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.030712:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a07ea2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ad9 expref: 54 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.030726:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209a000, rc 0) 00000100:00100000:3.0:1784938784.030818:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:10023:x1871643326091392:12345-192.168.202.4@tcp:101:cp.0 Request processed in 233us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.030825:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 94 00000100:00100000:1.0:1784938784.036578:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.036786:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326091520 00000100:00100000:0.0:1784938784.036796:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326091520 00000100:00100000:0.0:1784938784.036858:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 95 00000100:00100000:0.0:1784938784.036868:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:25037:x1871643326091520:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.036887:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.036906:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a07ea9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ae0 expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.036938:0:33065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a07ea2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ad9 expref: 55 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.036948:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.036952:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.036958:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a07ea9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ae0 expref: 55 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.037015:0:33065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a07ea2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ad9 expref: 55 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.037042:0:33065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a07ea2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ad9 expref: 55 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.037057:0:33065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342552448:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938784.037144:0:33065:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470507d540 going to sleep for 11 seconds 00000100:00100000:0.0:1784938784.042475:0:33065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342552448:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938784.042516:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a07ea9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->16383] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ae0 expref: 55 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.042541:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609397400, rc 0) 00000100:00100000:0.0:1784938784.042605:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:25037:x1871643326091520:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5738us (6038us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.042615:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 95 00000100:00100000:3.0:1784938784.044379:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.045223:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326091648 00000100:00100000:0.0:1784938784.045254:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326091648 00010000:00010000:0.0:1784938784.045306:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a07ea2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ad9 expref: 55 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.045352:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:0.0:1784938784.045361:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:10023:x1871643326091648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938784.045398:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938784.045421:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a07ea2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ad9 expref: 55 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.045437:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a07ea2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ad9 expref: 55 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.045458:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a07ea2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ad9 expref: 55 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.045475:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.045479:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.045486:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a07ea9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ae0 expref: 54 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.045497:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a07ea9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ae0 expref: 54 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.045535:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a07ea9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ae0 expref: 54 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.045563:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342552576:192.168.202.4@tcp:105: 00000100:00100000:0.0:1784938784.045656:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470507d540 going to sleep for 11 seconds 00010000:00010000:3.0:1784938784.056601:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938784.057163:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342552576:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938784.057188:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938784.057276:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:10023:x1871643326091648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 11914us (12905us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.057287:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:2.0:1784938784.069000:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.069654:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326091904 00000100:00100000:1.0:1784938784.069665:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326091904 00000100:00100000:1.0:1784938784.069723:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:1.0:1784938784.069734:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+138:25037:x1871643326091904:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:1.0:1784938784.070129:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+139:25037:x1871643326091904:12345-192.168.202.4@tcp:35:cp.0 Request processed in 386us (1127us total) trans 4294967384 rc 0/0 00000100:00100000:1.0:1784938784.070153:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:1.0:1784938784.075917:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.076015:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326092032 00000100:00100000:2.0:1784938784.076035:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326092032 00000100:00100000:2.0:1784938784.076091:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 146 00000100:00100000:2.0:1784938784.076100:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+139:25037:x1871643326092032:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.076357:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.076382:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07eb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ae7 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076449:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07eb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076479:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076492:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076508:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07ebe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076515:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076522:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076654:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076663:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07eb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076671:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076678:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.076682:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076689:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07eb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076702:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.076713:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.076718:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07eb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076724:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07eb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076739:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076745:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07ebe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076886:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07ebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076892:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.076895:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07ebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076900:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07ebe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076909:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x2fbacb41 (ffff97473e984500) 00010000:00010000:2.0:1784938784.076911:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.076914:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07ebe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076918:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07ebe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076956:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07eb0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ae7 expref: 140 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076974:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.076976:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.076980:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05400/0xcd9d312a94a07eb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ae7 expref: 140 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.076988:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05400, rc 0) 00000100:00100000:2.0:1784938784.077112:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+139:25037:x1871643326092032:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1012us (1215us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.077129:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 146 00000100:00100000:2.0:1784938784.083362:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.083401:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326092160 00000100:00100000:0.0:1784938784.083412:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326092160 00000100:00100000:0.0:1784938784.083481:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 147 00000100:00100000:0.0:1784938784.083491:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+139:25037:x1871643326092160:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.083512:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.083539:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a07ec5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5aee expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.083606:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ecc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.083622:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ecc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.083633:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ecc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.083663:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07ed3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.083670:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.083677:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.083775:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ecc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.083980:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ecc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.083987:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.083993:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.083998:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.084005:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ecc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.084016:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.084019:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.084024:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ecc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.084030:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ecc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.084043:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.084049:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07ed3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.084054:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.084059:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741250e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.084068:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.084074:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07ed3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.084082:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x2fbacb41 (ffff974705478d00) 00010000:00010000:0.0:1784938784.084085:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.084088:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07ed3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.084093:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07ed3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.084128:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a07ec5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5aee expref: 140 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.084138:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.084140:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.084144:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a07ec5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5aee expref: 140 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.084153:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251200, rc 0) 00000100:00100000:0.0:1784938784.084213:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+139:25037:x1871643326092160:12345-192.168.202.4@tcp:101:cp.0 Request processed in 722us (860us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.084220:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 147 00000100:00100000:1.0:1784938784.090592:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.090672:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326092416 00000100:00100000:0.0:1784938784.091562:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326092416 00000100:00100000:1.0:1784938784.091691:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 148 00000100:00100000:1.0:1784938784.091702:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+139:25037:x1871643326092416:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938784.091728:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938784.091794:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07eda lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5af5 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.091946:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07ee1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.091963:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07ee1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.092102:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07ee1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.092125:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07ee8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.092132:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.092138:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938784.093027:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17:0x0], index 0: 0 00010000:00010000:1.0:1784938784.093211:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07eef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.093246:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07eef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.093256:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07eef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.093296:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07ee1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.093303:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07ee1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.093310:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07ee1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.093315:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.093320:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07ee1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.093328:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07ee1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.093408:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938784.093412:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.093419:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07ee1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.093425:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07ee1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938784.093439:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f3a996cf reply state 00000000b50aa3e3 transno 4294967385 ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938784.093456:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938784.093492:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07eda lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5af5 expref: 142 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.093507:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07eef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5af5 expref: 141 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.093515:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff97473a027300) 00010000:00010000:1.0:1784938784.093518:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938784.093521:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568600, rc 0) 00000100:00100000:1.0:1784938784.093611:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+142:25037:x1871643326092416:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1910us (3028us total) trans 4294967385 rc 0/0 00000100:00100000:1.0:1784938784.093620:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 148 00000100:00100000:1.0:1784938784.099257:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.099470:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326092544 00000100:00100000:3.0:1784938784.099480:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326092544 00000100:00100000:3.0:1784938784.099583:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 96 00000100:00100000:3.0:1784938784.099594:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+26:10026:x1871643326092544:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.099613:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938784.099635:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a07efd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5afc expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938784.099662:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938784.099684:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=937s v=(0 0) 00010000:00010000:3.0:1784938784.099689:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.099699:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a07efd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5afc expref: 27 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.099715:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a07efd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5afc expref: 27 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.099728:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209a800, rc 0) 00000100:00100000:3.0:1784938784.099897:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:10026:x1871643326092544:12345-192.168.202.4@tcp:101:cp.0 Request processed in 305us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.099905:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 96 00010000:00010000:0.0:1784938784.101937:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.101977:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07ee8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.101985:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07ee8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.101992:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.101997:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07ee8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.102006:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07ee8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.102026:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x2fbacb41 (ffff97473a027f00) 00010000:00010000:0.0:1784938784.102029:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.102034:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07ee8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.102041:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569800/0xcd9d312a94a07ee8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2fbacb41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.115546:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.115696:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326092672 00000100:00100000:2.0:1784938784.115705:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326092672 00000100:00100000:2.0:1784938784.115798:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00100000:2.0:1784938784.115809:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:25037:x1871643326092672:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.115830:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.115850:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07f04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b03 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.115883:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a07efd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5afc expref: 28 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.115894:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.115898:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.115904:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07f04 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b03 expref: 28 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.115959:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a07efd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5afc expref: 28 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.115974:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a07efd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5afc expref: 28 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.116003:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703413100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342552704:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938784.116075:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a8229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938784.126190:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.126477:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326092800 00000100:00100000:3.0:1784938784.126486:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326092800 00010000:00010000:3.0:1784938784.126532:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a07efd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5afc expref: 29 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.126601:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:3.0:1784938784.126612:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10025:x1871643326092800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938784.126628:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938784.126658:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a07efd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5afc expref: 29 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.126675:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a07efd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5afc expref: 29 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.126702:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.126707:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.126716:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07f04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b03 expref: 29 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.126727:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07f04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b03 expref: 29 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.126783:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07f04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b03 expref: 29 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.126798:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342552832:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938784.126876:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce6180 going to sleep for 11 seconds 00010000:00010000:2.0:1784938784.126973:0:31425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a07efd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5afc expref: 29 pid: 31428 timeout: 1037 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.126988:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703413100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342552704:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938784.127015:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07f04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b03 expref: 28 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.127026:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05400, rc 0) 00000100:00100000:2.0:1784938784.127057:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:25037:x1871643326092672:12345-192.168.202.4@tcp:101:cp.0 Request processed in 11250us (11522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938784.127065:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00100000:3.0:1784938784.136365:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342552832:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938784.136410:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938784.136483:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:10025:x1871643326092800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9872us (10301us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.136495:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:0.0:1784938784.152067:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.152262:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326093056 00000100:00100000:1.0:1784938784.152273:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326093056 00000100:00100000:1.0:1784938784.152647:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:1.0:1784938784.152659:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+141:25037:x1871643326093056:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:1.0:1784938784.153335:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+142:25037:x1871643326093056:12345-192.168.202.4@tcp:35:cp.0 Request processed in 677us (1275us total) trans 4294967386 rc 0/0 00000100:00100000:1.0:1784938784.153416:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:1.0:1784938784.162145:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.167433:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326093184 00000100:00100000:0.0:1784938784.167450:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326093184 00000100:00100000:0.0:1784938784.167533:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 149 00000100:00100000:0.0:1784938784.167544:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+142:25037:x1871643326093184:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.167585:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.167609:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07f0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b0a expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.167706:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07f12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.167723:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07f12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.167739:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07f12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.167772:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07f19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.167781:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.167787:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.167855:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07f12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.167862:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07f12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.167869:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07f12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.168626:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.168632:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07f12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.168655:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07f12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.168671:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.168674:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.168680:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07f12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.168686:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07f12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.168704:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.168710:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07f19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.168717:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07f19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.168722:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741250600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.168724:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07f19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.168730:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07f19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.168736:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xff118af2 (ffff974705478d00) 00010000:00010000:0.0:1784938784.168739:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.168742:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07f19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.168806:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07f19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.168848:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07f0b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b0a expref: 143 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.168859:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.168862:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.168865:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250e00/0xcd9d312a94a07f0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b0a expref: 143 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.169030:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250e00, rc 0) 00000100:00100000:0.0:1784938784.169246:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+142:25037:x1871643326093184:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1700us (7108us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.169255:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 149 00000100:00100000:3.0:1784938784.181038:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.181221:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326093312 00000100:00100000:1.0:1784938784.181275:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326093312 00000100:00100000:1.0:1784938784.181347:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 150 00000100:00100000:1.0:1784938784.181374:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+142:25037:x1871643326093312:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938784.181397:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938784.181421:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07f20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b11 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181507:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07f27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181524:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07f27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181535:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07f27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181550:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07f2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181557:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181564:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181629:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07f27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181636:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07f27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181643:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07f27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181660:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.181663:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07f27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181670:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07f27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181683:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938784.181685:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.181689:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07f27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181909:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a07f27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181926:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181931:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07f2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181937:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181942:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.181945:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181951:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07f2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181972:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xff118af2 (ffff97473a027700) 00010000:00010000:1.0:1784938784.181975:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.181978:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07f2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.181986:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a07f2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.182022:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07f20 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b11 expref: 143 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.182032:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938784.182034:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.182038:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a07f20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b11 expref: 143 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.182046:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568000, rc 0) 00000100:00100000:1.0:1784938784.182106:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+142:25037:x1871643326093312:12345-192.168.202.4@tcp:101:cp.0 Request processed in 734us (1077us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938784.182115:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 150 00000100:00100000:3.0:1784938784.186885:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.186989:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326093568 00000100:00100000:2.0:1784938784.187000:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326093568 00000100:00100000:2.0:1784938784.187066:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 151 00000100:00100000:2.0:1784938784.187077:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+142:25037:x1871643326093568:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.187115:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.187138:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07f35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b18 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.187285:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07f3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.187300:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07f3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.187312:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07f3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.187328:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xff118af2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.187336:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.187344:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938784.187991:0:33061:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17:0x0], index 1: 0 00010000:00010000:2.0:1784938784.188152:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07f4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.188163:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.188172:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.188222:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07f3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.188239:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07f3c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.188246:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07f3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.188252:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.188256:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07f3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.188264:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07f3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.188276:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.188279:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.188283:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07f3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.188289:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07f3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938784.188299:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed2b6fae reply state 00000000d6dfd336 transno 4294967387 ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.188308:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938784.188335:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07f35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b18 expref: 145 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.188360:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07f4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b18 expref: 144 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.188368:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff97473e984300) 00010000:00010000:2.0:1784938784.188371:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938784.188373:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04800, rc 0) 00000100:00100000:2.0:1784938784.188449:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+145:25037:x1871643326093568:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1373us (1574us total) trans 4294967387 rc 0/0 00000100:00100000:2.0:1784938784.188457:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 151 00010000:00010000:1.0:1784938784.193823:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.193843:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.193851:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.193878:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.193883:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.193892:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.193908:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xff118af2 (ffff97473e984500) 00010000:00010000:1.0:1784938784.193911:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.193917:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.193924:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xff118af2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.196084:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.196175:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326093696 00000100:00100000:2.0:1784938784.196186:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326093696 00000100:00100000:2.0:1784938784.196249:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 98 00000100:00100000:2.0:1784938784.196259:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:10023:x1871643326093696:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.196278:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.196304:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ebf008a/0xcd9d312a94a07f58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b1f expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938784.196333:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938784.196358:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=938s v=(0 0) 00010000:00010000:2.0:1784938784.196363:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.196375:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ebf008a/0xcd9d312a94a07f58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b1f expref: 55 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.196396:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ebf008a/0xcd9d312a94a07f58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b1f expref: 55 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.196434:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04600, rc 0) 00000100:00100000:2.0:1784938784.196506:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:10023:x1871643326093696:12345-192.168.202.4@tcp:101:cp.0 Request processed in 248us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938784.196514:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 98 00000100:00100000:2.0:1784938784.205598:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.205722:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326093824 00000100:00100000:0.0:1784938784.205733:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326093824 00000100:00100000:0.0:1784938784.205824:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 99 00000100:00100000:0.0:1784938784.205835:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:25037:x1871643326093824:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.205857:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.205879:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c8a06ac/0xcd9d312a94a07f5f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b26 expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.205916:0:33065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ebf008a/0xcd9d312a94a07f58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b1f expref: 56 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.205944:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.205948:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.205954:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c8a06ac/0xcd9d312a94a07f5f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b26 expref: 56 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.205988:0:33065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ebf008a/0xcd9d312a94a07f58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b1f expref: 56 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.206001:0:33065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ebf008a/0xcd9d312a94a07f58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b1f expref: 56 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.206014:0:33065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342552960:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938784.206118:0:33065:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470507d540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938784.211010:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.211120:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326093952 00000100:00100000:2.0:1784938784.211131:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326093952 00010000:00010000:2.0:1784938784.211173:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ebf008a/0xcd9d312a94a07f58 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b1f expref: 57 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.211239:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:2.0:1784938784.211250:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10023:x1871643326093952:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938784.211265:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938784.211288:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ebf008a/0xcd9d312a94a07f58 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b1f expref: 57 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.211315:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ebf008a/0xcd9d312a94a07f58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b1f expref: 57 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.211342:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.211346:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.211353:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c8a06ac/0xcd9d312a94a07f5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b26 expref: 57 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.211383:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c8a06ac/0xcd9d312a94a07f5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b26 expref: 57 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.211420:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007c8a06ac/0xcd9d312a94a07f5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b26 expref: 57 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.211433:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703412680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342553088:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938784.211506:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a8229c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784938784.212007:0:33065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ebf008a/0xcd9d312a94a07f58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b1f expref: 57 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.212025:0:33065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342552960:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938784.212052:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c8a06ac/0xcd9d312a94a07f5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b26 expref: 56 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.212064:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250e00, rc 0) 00000100:00100000:0.0:1784938784.212109:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:25037:x1871643326093824:12345-192.168.202.4@tcp:101:cp.0 Request processed in 6275us (6526us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.212129:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 99 00000100:00100000:2.0:1784938784.216104:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703412680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342553088:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938784.216132:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938784.216203:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:10023:x1871643326093952:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4954us (5200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938784.216214:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:3.0:1784938784.222874:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.222979:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326094208 00000100:00100000:1.0:1784938784.222990:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326094208 00000100:00100000:1.0:1784938784.223118:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:1.0:1784938784.223130:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+144:25037:x1871643326094208:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:1.0:1784938784.224028:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+145:25037:x1871643326094208:12345-192.168.202.4@tcp:35:cp.0 Request processed in 896us (1159us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1784938784.224038:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:0.0:1784938784.230169:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.230439:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326094336 00000100:00100000:2.0:1784938784.230451:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326094336 00000100:00100000:2.0:1784938784.230516:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 152 00000100:00100000:2.0:1784938784.230526:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+145:25037:x1871643326094336:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.230551:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.230574:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07f66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b2d expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230644:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07f6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230659:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230690:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230706:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07f74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230713:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230719:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230835:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230843:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07f6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230850:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07f6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230856:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.230860:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07f6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230868:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07f6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230880:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.230883:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.230888:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07f6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230901:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07f6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230915:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230922:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07f74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230928:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230933:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.230937:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230943:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07f74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230951:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xb2d5a33e (ffff97473e984b00) 00010000:00010000:2.0:1784938784.230954:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.230957:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07f74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230963:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07f74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.230998:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07f66 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b2d expref: 146 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.231019:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.231021:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.231026:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05c00/0xcd9d312a94a07f66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b2d expref: 146 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.231035:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05c00, rc 0) 00000100:00100000:2.0:1784938784.231114:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+145:25037:x1871643326094336:12345-192.168.202.4@tcp:101:cp.0 Request processed in 589us (959us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.231121:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 152 00000100:00100000:3.0:1784938784.237004:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.237511:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326094464 00000100:00100000:2.0:1784938784.237521:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326094464 00000100:00100000:2.0:1784938784.237571:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 153 00000100:00100000:2.0:1784938784.237580:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+145:25037:x1871643326094464:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.237600:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.237622:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b34 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237688:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237701:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237712:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237728:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07f89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237784:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237792:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237867:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237874:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237880:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237885:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.237889:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237896:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237907:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.237910:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.237914:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237920:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237934:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237946:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07f89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237952:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237957:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.237960:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237966:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07f89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237974:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xb2d5a33e (ffff97473e984e00) 00010000:00010000:2.0:1784938784.237977:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.237980:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07f89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.237987:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07f89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.238024:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f7b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b34 expref: 146 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.238035:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.238037:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.238040:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07f7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b34 expref: 146 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.238071:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04e00, rc 0) 00000100:00100000:2.0:1784938784.238136:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+145:25037:x1871643326094464:12345-192.168.202.4@tcp:101:cp.0 Request processed in 556us (1141us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.238144:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 153 00000100:00100000:3.0:1784938784.252123:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.259990:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326094720 00000100:00100000:2.0:1784938784.260010:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326094720 00000100:00100000:2.0:1784938784.260091:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 154 00000100:00100000:2.0:1784938784.260112:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+145:25037:x1871643326094720:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.260258:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.260283:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07f90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b3b expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.260426:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07f97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.260441:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07f97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.260454:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07f97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.260473:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.260480:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.260493:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938784.261050:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18:0x0], index 0: 0 00010000:00010000:2.0:1784938784.261454:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07fa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.261467:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.261475:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.261510:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07f97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.261518:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07f97 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.261524:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07f97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.261531:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924e000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.261536:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07f97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.261544:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07f97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.261556:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.261559:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.261564:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07f97 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.261584:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07f97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938784.261598:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ba85c3a reply state 0000000013167de0 transno 4294967389 ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.261607:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938784.261642:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07f90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b3b expref: 148 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.261657:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b3b expref: 147 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.261664:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff97473e984b00) 00010000:00010000:2.0:1784938784.261666:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938784.261669:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04e00, rc 0) 00000100:00100000:2.0:1784938784.261847:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+148:25037:x1871643326094720:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1746us (9733us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1784938784.261856:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 154 00010000:00010000:0.0:1784938784.269858:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.269876:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.269884:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.269891:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.269896:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.269904:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.269922:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xb2d5a33e (ffff97473e984e00) 00010000:00010000:0.0:1784938784.269925:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.269930:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.269937:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a07f9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xb2d5a33e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.270087:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.270730:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326094848 00000100:00100000:0.0:1784938784.270740:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326094848 00000100:00100000:0.0:1784938784.270809:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 100 00000100:00100000:0.0:1784938784.270819:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+27:10025:x1871643326094848:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.270853:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.270873:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab92ec25/0xcd9d312a94a07fb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b42 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938784.270901:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938784.270923:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=938s v=(0 0) 00010000:00010000:0.0:1784938784.270928:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.270937:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab92ec25/0xcd9d312a94a07fb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b42 expref: 28 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.270955:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab92ec25/0xcd9d312a94a07fb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b42 expref: 28 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.270968:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251600, rc 0) 00000100:00100000:0.0:1784938784.271036:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:10025:x1871643326094848:12345-192.168.202.4@tcp:101:cp.0 Request processed in 218us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.271044:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 100 00000100:00100000:3.0:1784938784.278590:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.278702:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326094976 00000100:00100000:2.0:1784938784.278713:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326094976 00000100:00100000:2.0:1784938784.278807:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 101 00000100:00100000:2.0:1784938784.278818:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:25037:x1871643326094976:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.278838:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.278857:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a07fba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b49 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.278912:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab92ec25/0xcd9d312a94a07fb3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b42 expref: 29 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.278922:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.278926:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.278931:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a07fba lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b49 expref: 29 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.278965:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab92ec25/0xcd9d312a94a07fb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b42 expref: 29 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.278979:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab92ec25/0xcd9d312a94a07fb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b42 expref: 29 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.278993:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703412680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342553216:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938784.279074:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460262bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938784.284367:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703412680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342553216:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938784.284408:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a07fba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b49 expref: 29 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.284432:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05c00, rc 0) 00000100:00100000:2.0:1784938784.284506:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:25037:x1871643326094976:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5689us (5923us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938784.284515:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 101 00000100:00100000:3.0:1784938784.289277:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.289943:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326095104 00000100:00100000:2.0:1784938784.289953:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326095104 00010000:00010000:2.0:1784938784.289996:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab92ec25/0xcd9d312a94a07fb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b42 expref: 29 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.290044:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:2.0:1784938784.290053:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747194aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10026:x1871643326095104:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938784.290068:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938784.290093:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab92ec25/0xcd9d312a94a07fb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b42 expref: 29 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.290459:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab92ec25/0xcd9d312a94a07fb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b42 expref: 29 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.290485:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab92ec25/0xcd9d312a94a07fb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b42 expref: 29 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.290505:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.290509:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.290517:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a07fba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b49 expref: 28 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.290528:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a07fba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b49 expref: 28 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.290567:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a07fba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b49 expref: 28 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.290598:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703412680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342553344:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938784.290729:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460262bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938784.309747:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.309974:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703412680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342553344:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938784.309999:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938784.310056:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747194aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:10026:x1871643326095104:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 20003us (20789us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938784.310067:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:0.0:1784938784.310263:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326095360 00000100:00100000:0.0:1784938784.310272:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326095360 00000100:00100000:0.0:1784938784.310330:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:0.0:1784938784.310340:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705cdb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+147:25037:x1871643326095360:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938784.310705:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705cdb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+148:25037:x1871643326095360:12345-192.168.202.4@tcp:35:cp.0 Request processed in 366us (969us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1784938784.310713:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:1.0:1784938784.316715:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.316830:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326095488 00000100:00100000:2.0:1784938784.316840:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326095488 00000100:00100000:2.0:1784938784.316900:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 155 00000100:00100000:2.0:1784938784.316909:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+148:25037:x1871643326095488:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.316932:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.316955:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07fc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b50 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317021:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07fc8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317037:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317049:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317068:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07fcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317097:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317105:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317185:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317193:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07fc8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317199:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317205:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.317209:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317217:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07fc8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317239:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.317242:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.317408:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07fc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317416:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a07fc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317430:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317443:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07fcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317449:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317454:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.317458:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317464:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07fcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317472:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4958ff4 (ffff97473e984200) 00010000:00010000:2.0:1784938784.317475:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.317478:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07fcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317484:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a07fcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317520:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07fc1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b50 expref: 149 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317530:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.317533:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.317537:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a07fc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b50 expref: 149 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.317560:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04200, rc 0) 00000100:00100000:2.0:1784938784.317717:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+148:25037:x1871643326095488:12345-192.168.202.4@tcp:101:cp.0 Request processed in 808us (1010us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.317725:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 155 00000100:00100000:0.0:1784938784.324577:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.324677:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326095616 00000100:00100000:2.0:1784938784.324690:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326095616 00000100:00100000:2.0:1784938784.324772:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 156 00000100:00100000:2.0:1784938784.324784:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+148:25037:x1871643326095616:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.324804:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.324828:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07fd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b57 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.324893:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a07fdd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.324919:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a07fdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.324931:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a07fdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.324947:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07fe4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.324955:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.324962:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325042:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a07fdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325050:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a07fdd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325056:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a07fdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325062:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.325067:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a07fdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325074:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a07fdd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325087:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.325090:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.325095:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a07fdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325113:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a07fdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325135:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325141:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07fe4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325147:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325160:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.325163:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325170:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325178:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4958ff4 (ffff97473e984e00) 00010000:00010000:2.0:1784938784.325181:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.325184:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07fe4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325189:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a07fe4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325235:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07fd6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b57 expref: 149 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325515:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.325519:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.325526:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a07fd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b57 expref: 149 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.325548:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924e000, rc 0) 00000100:00100000:2.0:1784938784.325626:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+148:25037:x1871643326095616:12345-192.168.202.4@tcp:101:cp.0 Request processed in 843us (1057us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.325634:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 156 00000100:00100000:2.0:1784938784.329871:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.330126:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326095872 00000100:00100000:0.0:1784938784.330136:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326095872 00000100:00100000:0.0:1784938784.330197:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 157 00000100:00100000:0.0:1784938784.330207:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+148:25037:x1871643326095872:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.330238:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.331546:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07feb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b5e expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.331718:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ff2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.331733:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ff2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.331746:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ff2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.331787:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07ff9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.331795:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.331802:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938784.333192:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18:0x0], index 1: 0 00010000:00010000:0.0:1784938784.333982:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a08000 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.333999:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a08000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.334022:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a08000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.334062:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ff2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.334069:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ff2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.334076:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ff2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.334082:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.334086:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ff2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.334094:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ff2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.334106:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.334109:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.334113:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ff2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.334611:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a07ff2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938784.334628:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006bb7e330 reply state 00000000220adbc1 transno 4294967391 ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.334683:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938784.334733:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a07feb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b5e expref: 151 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.334960:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a08000 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b5e expref: 150 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.334970:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff974705478100) 00010000:00010000:0.0:1784938784.334973:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938784.334976:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251200, rc 0) 00000100:00100000:0.0:1784938784.335099:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+151:25037:x1871643326095872:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4891us (5235us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1784938784.335108:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 157 00000100:00100000:1.0:1784938784.343554:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.343637:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326096000 00000100:00100000:0.0:1784938784.343648:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326096000 00000100:00100000:0.0:1784938784.343713:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 102 00000100:00100000:0.0:1784938784.343723:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:10024:x1871643326096000:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.343744:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.343791:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a0800e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b65 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938784.343818:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938784.343838:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=938s v=(0 0) 00010000:00010000:0.0:1784938784.343843:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.343853:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a0800e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b65 expref: 56 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.343870:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a0800e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b65 expref: 56 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.343900:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251e00, rc 0) 00000100:00100000:0.0:1784938784.343961:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:10024:x1871643326096000:12345-192.168.202.4@tcp:101:cp.0 Request processed in 239us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.343968:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 102 00000100:00100000:3.0:1784938784.347307:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.347685:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326096128 00000100:00100000:1.0:1784938784.347696:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326096128 00000100:00100000:1.0:1784938784.347766:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 103 00000100:00100000:1.0:1784938784.347791:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:25037:x1871643326096128:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938784.347807:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938784.347825:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6937f9d/0xcd9d312a94a08015 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b6c expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.347858:0:33065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a0800e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b65 expref: 57 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.347868:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938784.347872:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938784.347878:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6937f9d/0xcd9d312a94a08015 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b6c expref: 57 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.348063:0:33065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a0800e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b65 expref: 57 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.348080:0:33065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a0800e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b65 expref: 57 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938784.348095:0:33065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342553472:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938784.348398:0:33065:0:(client.c:2702:ptlrpc_set_wait()) set ffff974609d3f300 going to sleep for 11 seconds 00010000:00010000:2.0:1784938784.348539:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07ff9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.348550:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07ff9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.348558:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07ff9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.348564:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741250600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.348570:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07ff9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.348578:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07ff9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.348595:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4958ff4 (ffff974705478500) 00010000:00010000:2.0:1784938784.348598:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.348603:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07ff9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.348610:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a07ff9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4958ff4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938784.353072:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.353349:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326096256 00000100:00100000:2.0:1784938784.353360:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326096256 00010000:00010000:2.0:1784938784.353404:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a0800e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b65 expref: 58 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.353440:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:2.0:1784938784.353449:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10023:x1871643326096256:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938784.353478:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938784.353501:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a0800e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b65 expref: 58 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.353518:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a0800e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b65 expref: 58 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.353543:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.353549:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.353557:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6937f9d/0xcd9d312a94a08015 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b6c expref: 58 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.353568:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6937f9d/0xcd9d312a94a08015 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b6c expref: 58 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.353605:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e6937f9d/0xcd9d312a94a08015 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b6c expref: 58 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.353620:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703410a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342553600:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938784.353696:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460262b300 going to sleep for 11 seconds 00010000:00010000:0.0:1784938784.354571:0:33065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a0800e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b65 expref: 58 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.354589:0:33065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342553472:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938784.354618:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6937f9d/0xcd9d312a94a08015 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b6c expref: 57 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.354631:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569800, rc 0) 00000100:00100000:0.0:1784938784.354685:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:25037:x1871643326096128:12345-192.168.202.4@tcp:101:cp.0 Request processed in 6895us (7397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.354693:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 103 00000100:00100000:2.0:1784938784.361313:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703410a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342553600:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938784.361341:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938784.361414:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:10023:x1871643326096256:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7964us (8350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938784.361425:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:1.0:1784938784.363690:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.363797:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326096512 00000100:00100000:0.0:1784938784.363806:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326096512 00000100:00100000:0.0:1784938784.363851:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:0.0:1784938784.363860:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+150:25037:x1871643326096512:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938784.364243:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+151:25037:x1871643326096512:12345-192.168.202.4@tcp:35:cp.0 Request processed in 381us (561us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1784938784.364257:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:3.0:1784938784.369320:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.369436:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326096640 00000100:00100000:2.0:1784938784.369446:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326096640 00000100:00100000:2.0:1784938784.369509:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 158 00000100:00100000:2.0:1784938784.369518:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+151:25037:x1871643326096640:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.369549:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.369573:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0801c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b73 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.369649:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08023 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.369664:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08023 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.369675:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08023 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.369691:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0802a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.369699:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0802a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.369706:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0802a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.369819:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08023 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.369827:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08023 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.369851:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08023 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.369857:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.369862:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08023 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.369869:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08023 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.369882:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.369885:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.369889:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08023 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.369896:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08023 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.370010:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0802a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.370017:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0802a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.370023:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0802a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.370028:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.370031:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0802a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.370047:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0802a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.370055:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x57ba1cca (ffff97473e984e00) 00010000:00010000:2.0:1784938784.370058:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.370061:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0802a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.370067:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0802a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.370098:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0801c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b73 expref: 152 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.370106:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.370108:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.370112:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0801c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b73 expref: 152 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.370119:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e00600, rc 0) 00000100:00100000:2.0:1784938784.370274:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+151:25037:x1871643326096640:12345-192.168.202.4@tcp:101:cp.0 Request processed in 757us (966us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.370281:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 158 00000100:00100000:2.0:1784938784.374256:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.374388:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326096768 00000100:00100000:1.0:1784938784.374398:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326096768 00000100:00100000:1.0:1784938784.374454:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 159 00000100:00100000:1.0:1784938784.374480:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+151:25037:x1871643326096768:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938784.374503:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938784.374525:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a08031 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b7a expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374594:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a08038 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374610:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a08038 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374622:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a08038 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374638:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a0803f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374644:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a0803f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374650:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a0803f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374720:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a08038 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374727:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a08038 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374733:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a08038 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374896:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.374902:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a08038 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374912:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a08038 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374926:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938784.374929:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.374934:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a08038 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374941:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a08038 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374954:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a0803f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374960:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a0803f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374967:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a0803f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374972:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735569c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.374975:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a0803f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374981:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a0803f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.374999:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x57ba1cca (ffff97473a027700) 00010000:00010000:1.0:1784938784.375002:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.375005:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a0803f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.375012:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a0803f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.375046:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a08031 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b7a expref: 152 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.375057:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938784.375059:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.375063:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568000/0xcd9d312a94a08031 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b7a expref: 152 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.375073:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568000, rc 0) 00000100:00100000:1.0:1784938784.375136:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+151:25037:x1871643326096768:12345-192.168.202.4@tcp:101:cp.0 Request processed in 658us (910us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938784.375145:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 159 00000100:00100000:1.0:1784938784.379526:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.379606:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326097024 00000100:00100000:3.0:1784938784.379618:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326097024 00000100:00100000:3.0:1784938784.379691:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 160 00000100:00100000:3.0:1784938784.379702:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+151:25037:x1871643326097024:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.379728:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.380639:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a08046 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b81 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.381004:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a0804d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.381020:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a0804d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.381033:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a0804d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.381049:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a08054 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.381055:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a08054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.381061:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a08054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938784.381684:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19:0x0], index 0: 0 00010000:00010000:0.0:1784938784.382168:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a0805b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.382181:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a0805b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.382191:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a0805b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.382238:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a0804d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.382380:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a0804d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.382387:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a0804d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.382393:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741251e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.382397:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a0804d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.382406:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a0804d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.382420:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.382423:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.382429:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a0804d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.382434:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251e00/0xcd9d312a94a0804d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938784.382448:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029609c7e reply state 00000000df6f491f transno 4294967393 ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a08054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.382457:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938784.382496:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a08046 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b81 expref: 154 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.382512:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a0805b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b81 expref: 153 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.382532:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff97460907cf00) 00010000:00010000:0.0:1784938784.382534:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938784.382537:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251600, rc 0) 00000100:00100000:0.0:1784938784.382668:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+154:25037:x1871643326097024:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2966us (3150us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1784938784.382678:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 160 00000100:00100000:2.0:1784938784.390077:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.390362:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326097152 00000100:00100000:3.0:1784938784.390373:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326097152 00000100:00100000:3.0:1784938784.390442:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 104 00000100:00100000:3.0:1784938784.390463:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+28:10025:x1871643326097152:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.390482:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938784.390505:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08069 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b88 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938784.390552:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938784.390575:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=938s v=(0 0) 00010000:00010000:3.0:1784938784.390581:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.390590:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08069 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b88 expref: 29 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.390610:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08069 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b88 expref: 29 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.390625:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209a800, rc 0) 00000100:00100000:3.0:1784938784.390686:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10025:x1871643326097152:12345-192.168.202.4@tcp:101:cp.0 Request processed in 235us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.390693:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 104 00010000:00010000:0.0:1784938784.393523:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a08054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.393542:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a08054 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.393550:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a08054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.393557:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741250600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.393562:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a08054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.393571:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a08054 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.393591:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x57ba1cca (ffff97460907ca00) 00010000:00010000:0.0:1784938784.393595:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.393601:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a08054 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.393608:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a08054 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x57ba1cca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.394448:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.394700:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326097280 00000100:00100000:1.0:1784938784.394710:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326097280 00000100:00100000:1.0:1784938784.394788:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 105 00000100:00100000:1.0:1784938784.394799:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:25037:x1871643326097280:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938784.394817:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938784.394836:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cd6c8dc/0xcd9d312a94a08070 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b8f expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.394874:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08069 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b88 expref: 30 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.394884:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938784.394888:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938784.394894:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cd6c8dc/0xcd9d312a94a08070 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b8f expref: 30 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.394927:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08069 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b88 expref: 30 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.394942:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08069 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b88 expref: 30 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938784.394959:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342553728:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938784.395180:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff974609d3f300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938784.398708:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.398827:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342553728:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938784.398864:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008cd6c8dc/0xcd9d312a94a08070 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b8f expref: 30 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.398886:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568000, rc 0) 00000100:00100000:1.0:1784938784.398961:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:25037:x1871643326097280:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4163us (4518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938784.398971:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 105 00000100:00100000:2.0:1784938784.399802:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326097408 00000100:00100000:2.0:1784938784.399811:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326097408 00010000:00010000:2.0:1784938784.399859:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08069 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b88 expref: 30 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.399889:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:2.0:1784938784.399897:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:10025:x1871643326097408:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938784.400120:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938784.400147:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08069 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b88 expref: 30 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.400162:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08069 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b88 expref: 30 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.400187:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08069 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b88 expref: 30 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.400202:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.400206:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.400214:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008cd6c8dc/0xcd9d312a94a08070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b8f expref: 29 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.400236:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cd6c8dc/0xcd9d312a94a08070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b8f expref: 29 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.400281:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008cd6c8dc/0xcd9d312a94a08070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b8f expref: 29 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.400316:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703413800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342553856:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938784.400431:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460262b300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938784.406361:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.406458:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326097664 00000100:00100000:0.0:1784938784.406470:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326097664 00000100:00100000:0.0:1784938784.406535:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:0.0:1784938784.406546:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+153:25037:x1871643326097664:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938784.406932:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+154:25037:x1871643326097664:12345-192.168.202.4@tcp:35:cp.0 Request processed in 388us (582us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1784938784.406941:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:2.0:1784938784.407105:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703413800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342553856:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938784.407126:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938784.407151:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10025:x1871643326097408:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7254us (8454us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938784.407159:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:0.0:1784938784.411594:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.411690:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326097792 00000100:00100000:1.0:1784938784.411699:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326097792 00000100:00100000:1.0:1784938784.411798:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 161 00000100:00100000:1.0:1784938784.411809:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+154:25037:x1871643326097792:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938784.411838:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938784.411860:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a08077 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b96 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.411942:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0807e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.411955:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0807e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.411966:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0807e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.411982:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a08085 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.411988:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a08085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.411994:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a08085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412058:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0807e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412065:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0807e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412090:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0807e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412096:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735568800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.412100:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0807e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412109:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0807e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412123:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938784.412126:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.412130:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0807e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412136:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568800/0xcd9d312a94a0807e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412150:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a08085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412156:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a08085 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412161:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a08085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412165:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.412168:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a08085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412183:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a08085 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412191:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x407c6222 (ffff97473a027700) 00010000:00010000:1.0:1784938784.412193:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.412196:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a08085 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412201:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a08085 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412246:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a08077 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b96 expref: 155 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412257:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938784.412260:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.412264:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a08077 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b96 expref: 155 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.412274:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569c00, rc 0) 00000100:00100000:1.0:1784938784.412541:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+154:25037:x1871643326097792:12345-192.168.202.4@tcp:101:cp.0 Request processed in 732us (956us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938784.412549:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 161 00000100:00100000:3.0:1784938784.420494:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.420601:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326097920 00000100:00100000:2.0:1784938784.420614:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326097920 00000100:00100000:2.0:1784938784.420688:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 162 00000100:00100000:2.0:1784938784.420697:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+154:25037:x1871643326097920:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.420723:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.420747:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a0808c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5b9d expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.420887:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08093 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.420902:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08093 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.420928:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08093 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.420948:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0809a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.420969:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0809a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.420977:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0809a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421042:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08093 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421050:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08093 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421056:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08093 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421062:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.421066:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08093 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421073:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08093 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421086:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.421088:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.421093:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08093 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421098:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08093 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421111:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0809a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421134:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0809a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421139:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0809a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421144:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.421147:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0809a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421153:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0809a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421162:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x407c6222 (ffff97473e984e00) 00010000:00010000:2.0:1784938784.421164:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.421167:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0809a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421173:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a0809a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421208:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a0808c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b9d expref: 155 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421217:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.421220:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.421236:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a0808c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b9d expref: 155 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.421259:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924e000, rc 0) 00000100:00100000:2.0:1784938784.421325:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+154:25037:x1871643326097920:12345-192.168.202.4@tcp:101:cp.0 Request processed in 629us (843us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.421333:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 162 00000100:00100000:3.0:1784938784.425996:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.426169:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326098176 00000100:00100000:1.0:1784938784.426180:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326098176 00000100:00100000:1.0:1784938784.426254:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 163 00000100:00100000:1.0:1784938784.426264:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+154:25037:x1871643326098176:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938784.426314:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938784.426339:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a080a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ba4 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.426480:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a080a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.426496:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a080a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.426507:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a080a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.426523:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a080af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x407c6222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.426530:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a080af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.426537:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a080af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938784.427446:0:33061:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19:0x0], index 1: 0 00010000:00010000:1.0:1784938784.427609:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a080b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.427621:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a080b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.427631:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a080b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.427678:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a080a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.427686:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a080a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.427693:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a080a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.427699:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.427703:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a080a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.427711:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a080a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.427723:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938784.427726:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.427731:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a080a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.427738:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a080a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938784.428003:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b50288c3 reply state 00000000ea8644d5 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a080af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938784.428015:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938784.428049:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29e00/0xcd9d312a94a080a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ba4 expref: 157 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.428077:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a080b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ba4 expref: 156 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.428085:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff97473a027f00) 00010000:00010000:1.0:1784938784.428088:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938784.428090:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735569c00, rc 0) 00000100:00100000:1.0:1784938784.428199:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+157:25037:x1871643326098176:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1935us (2211us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1784938784.428208:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 163 00000100:00100000:3.0:1784938784.433829:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.433953:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326098304 00000100:00100000:0.0:1784938784.433964:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326098304 00000100:00100000:0.0:1784938784.434021:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 106 00000100:00100000:0.0:1784938784.434032:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:10023:x1871643326098304:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.434052:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.434077:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc5ab0da/0xcd9d312a94a080c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5bab expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938784.434106:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938784.434126:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=938s v=(0 0) 00010000:00010000:0.0:1784938784.434131:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.434141:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc5ab0da/0xcd9d312a94a080c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bab expref: 57 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.434159:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc5ab0da/0xcd9d312a94a080c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bab expref: 57 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.434200:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250600, rc 0) 00000100:00100000:0.0:1784938784.434294:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10023:x1871643326098304:12345-192.168.202.4@tcp:101:cp.0 Request processed in 259us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.434303:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 106 00010000:00010000:2.0:1784938784.435632:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a080af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.435651:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a080af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.435660:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a080af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.435666:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f29000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.435671:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a080af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.435679:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a080af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.435699:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x407c6222 (ffff97473a027700) 00010000:00010000:2.0:1784938784.435703:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.435707:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a080af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.435713:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a080af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x407c6222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938784.438855:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.438956:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326098432 00000100:00100000:0.0:1784938784.438967:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326098432 00000100:00100000:0.0:1784938784.439028:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 107 00000100:00100000:0.0:1784938784.439038:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:25037:x1871643326098432:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.439057:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.439076:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a080cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5bb2 expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.439108:0:33065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc5ab0da/0xcd9d312a94a080c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bab expref: 58 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.439118:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.439122:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.439128:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a080cb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bb2 expref: 58 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.439162:0:33065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc5ab0da/0xcd9d312a94a080c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bab expref: 58 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.439177:0:33065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc5ab0da/0xcd9d312a94a080c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bab expref: 58 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.439209:0:33065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342553984:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938784.439307:0:33065:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470507d600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938784.443494:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.443591:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326098560 00000100:00100000:2.0:1784938784.443619:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326098560 00010000:00010000:2.0:1784938784.443660:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc5ab0da/0xcd9d312a94a080c4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bab expref: 59 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.443706:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:2.0:1784938784.443715:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:10024:x1871643326098560:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938784.443731:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938784.443787:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc5ab0da/0xcd9d312a94a080c4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bab expref: 59 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.443801:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc5ab0da/0xcd9d312a94a080c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bab expref: 59 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.443825:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.443831:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.443839:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a080cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bb2 expref: 59 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.443849:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a080cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bb2 expref: 59 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.443887:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a080cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bb2 expref: 59 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.443902:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703413800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342554112:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938784.443992:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460262b300 going to sleep for 11 seconds 00010000:00010000:0.0:1784938784.444985:0:33065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc5ab0da/0xcd9d312a94a080c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bab expref: 59 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.445005:0:33065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342553984:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938784.445033:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a080cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bb2 expref: 58 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.445048:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741251e00, rc 0) 00000100:00100000:0.0:1784938784.445099:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:25037:x1871643326098432:12345-192.168.202.4@tcp:101:cp.0 Request processed in 6062us (6254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.445108:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 107 00000100:00100000:1.0:1784938784.449942:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.450060:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703413800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342554112:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938784.450083:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938784.450142:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10024:x1871643326098560:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6427us (6656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.450155:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:3.0:1784938784.450239:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326098816 00000100:00100000:3.0:1784938784.450246:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326098816 00000100:00100000:3.0:1784938784.450304:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:3.0:1784938784.450312:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+156:25037:x1871643326098816:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938784.450618:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+157:25037:x1871643326098816:12345-192.168.202.4@tcp:35:cp.0 Request processed in 306us (686us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1784938784.450642:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:3.0:1784938784.455728:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.455956:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326098944 00000100:00100000:2.0:1784938784.455967:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326098944 00000100:00100000:2.0:1784938784.456033:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 164 00000100:00100000:2.0:1784938784.456043:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+157:25037:x1871643326098944:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.456068:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.456090:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a080d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5bb9 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456152:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a080d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456166:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a080d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456177:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a080d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456192:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a080e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456198:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a080e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456204:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a080e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456284:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a080d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456300:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a080d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456342:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a080d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456348:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.456352:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a080d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456360:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a080d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456372:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.456376:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.456379:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a080d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456386:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a080d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456399:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a080e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456405:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a080e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456411:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a080e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456415:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.456418:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a080e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456435:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a080e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456444:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x239dea14 (ffff97473e984e00) 00010000:00010000:2.0:1784938784.456447:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.456449:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a080e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456455:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a080e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456488:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a080d2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bb9 expref: 158 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456498:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.456500:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.456504:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a080d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bb9 expref: 158 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.456514:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e00600, rc 0) 00000100:00100000:2.0:1784938784.456622:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+157:25037:x1871643326098944:12345-192.168.202.4@tcp:101:cp.0 Request processed in 579us (903us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.456629:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 164 00000100:00100000:1.0:1784938784.460408:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.461003:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326099072 00000100:00100000:0.0:1784938784.461014:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326099072 00000100:00100000:0.0:1784938784.461067:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 165 00000100:00100000:0.0:1784938784.461077:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+157:25037:x1871643326099072:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.461099:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.461138:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a080e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5bc0 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461207:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a080ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461266:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a080ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461280:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a080ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461305:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a080f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461313:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a080f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461319:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a080f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461383:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a080ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461390:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a080ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461397:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a080ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461403:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.461407:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a080ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461425:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a080ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461438:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.461441:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.461446:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a080ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461452:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a080ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461466:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a080f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461471:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a080f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461477:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a080f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461483:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.461485:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a080f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461491:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a080f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461498:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x239dea14 (ffff97460907cd00) 00010000:00010000:0.0:1784938784.461501:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.461504:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a080f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461520:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a080f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461556:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a080e7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bc0 expref: 158 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461566:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.461569:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.461572:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a080e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bc0 expref: 158 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.461583:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250600, rc 0) 00000100:00100000:0.0:1784938784.461648:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+157:25037:x1871643326099072:12345-192.168.202.4@tcp:101:cp.0 Request processed in 572us (1249us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.461656:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 165 00000100:00100000:1.0:1784938784.467094:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.467184:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326099328 00000100:00100000:2.0:1784938784.467194:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326099328 00000100:00100000:2.0:1784938784.467265:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 166 00000100:00100000:2.0:1784938784.467276:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+157:25037:x1871643326099328:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.467322:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.467344:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a080fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5bc7 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.467474:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08103 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.467489:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08103 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.467500:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08103 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.467515:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0810a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x239dea14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.467522:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0810a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.467529:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0810a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938784.468030:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a:0x0], index 0: 0 00010000:00010000:2.0:1784938784.468191:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a08111 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.468201:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a08111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.468210:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a08111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.468269:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08103 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.468277:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08103 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.468283:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08103 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.468290:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.468294:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08103 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.468301:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08103 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.468313:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.468317:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.468322:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08103 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.468329:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08103 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938784.468342:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aede7e42 reply state 000000007da0f8cd transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0810a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.468352:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938784.468384:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a080fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bc7 expref: 160 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.468411:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a08111 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bc7 expref: 159 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.468419:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff97473e984200) 00010000:00010000:2.0:1784938784.468422:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938784.468425:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924e000, rc 0) 00000100:00100000:2.0:1784938784.468500:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+160:25037:x1871643326099328:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1226us (1416us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1784938784.468510:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 166 00010000:00010000:0.0:1784938784.472280:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0810a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.472310:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0810a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.472317:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0810a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.472323:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.472327:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0810a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.472334:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0810a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.472371:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x239dea14 (ffff97473e984e00) 00010000:00010000:0.0:1784938784.472375:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.472380:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0810a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.472386:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0810a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x239dea14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938784.473495:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.473663:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326099456 00000100:00100000:0.0:1784938784.473673:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326099456 00000100:00100000:0.0:1784938784.473726:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 108 00000100:00100000:0.0:1784938784.473735:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+29:10026:x1871643326099456:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.473784:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.473804:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c503ecd6/0xcd9d312a94a0811f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5bce expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938784.473831:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938784.473851:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=938s v=(0 0) 00010000:00010000:0.0:1784938784.473856:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.473865:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c503ecd6/0xcd9d312a94a0811f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bce expref: 30 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.473882:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c503ecd6/0xcd9d312a94a0811f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bce expref: 30 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.473896:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974700030600, rc 0) 00000100:00100000:0.0:1784938784.473969:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:10026:x1871643326099456:12345-192.168.202.4@tcp:101:cp.0 Request processed in 235us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.473977:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 108 00000100:00100000:3.0:1784938784.477882:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.478046:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326099584 00000100:00100000:1.0:1784938784.478055:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326099584 00000100:00100000:1.0:1784938784.478109:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 109 00000100:00100000:1.0:1784938784.478120:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:25037:x1871643326099584:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938784.478139:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938784.478161:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d13bd41/0xcd9d312a94a08126 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5bd5 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.478195:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c503ecd6/0xcd9d312a94a0811f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bce expref: 31 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.478240:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938784.478245:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938784.478251:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d13bd41/0xcd9d312a94a08126 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bd5 expref: 31 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.478289:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c503ecd6/0xcd9d312a94a0811f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bce expref: 31 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.478372:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c503ecd6/0xcd9d312a94a0811f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bce expref: 31 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938784.478387:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472fc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342554240:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938784.478480:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747061f1840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938784.484446:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.484826:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326099712 00000100:00100000:0.0:1784938784.484837:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326099712 00010000:00010000:0.0:1784938784.484879:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c503ecd6/0xcd9d312a94a0811f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bce expref: 32 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.484926:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:0.0:1784938784.484936:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:10026:x1871643326099712:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938784.484954:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938784.484980:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c503ecd6/0xcd9d312a94a0811f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bce expref: 32 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.484995:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c503ecd6/0xcd9d312a94a0811f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bce expref: 32 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.485021:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.485026:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.485035:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d13bd41/0xcd9d312a94a08126 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bd5 expref: 32 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.485045:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d13bd41/0xcd9d312a94a08126 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bd5 expref: 32 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.485081:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000d13bd41/0xcd9d312a94a08126 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bd5 expref: 32 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.485114:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342554368:192.168.202.4@tcp:105: 00000100:00100000:0.0:1784938784.485197:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470507d600 going to sleep for 11 seconds 00010000:00010000:3.0:1784938784.486840:0:31425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c503ecd6/0xcd9d312a94a0811f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bce expref: 32 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.486863:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472fc8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342554240:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938784.486894:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d13bd41/0xcd9d312a94a08126 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bd5 expref: 31 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.487025:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735568800, rc 0) 00000100:00100000:3.0:1784938784.487187:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:25037:x1871643326099584:12345-192.168.202.4@tcp:101:cp.0 Request processed in 9068us (9314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.487196:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 109 00000100:00100000:1.0:1784938784.491029:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.491103:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326099968 00000100:00100000:3.0:1784938784.491112:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326099968 00000100:00100000:3.0:1784938784.491179:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:3.0:1784938784.491189:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+159:25037:x1871643326099968:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938784.491624:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+160:25037:x1871643326099968:12345-192.168.202.4@tcp:35:cp.0 Request processed in 435us (603us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1784938784.491633:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:0.0:1784938784.494632:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342554368:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938784.494662:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938784.494745:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:10026:x1871643326099712:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 9808us (10306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.494786:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:1.0:1784938784.496219:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.496617:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326100096 00000100:00100000:0.0:1784938784.496626:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326100096 00000100:00100000:0.0:1784938784.496686:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 167 00000100:00100000:0.0:1784938784.496696:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+160:25037:x1871643326100096:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.496722:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.496745:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a0812d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5bdc expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.496848:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08134 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.496864:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08134 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.496876:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08134 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.496930:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a0813b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.496949:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a0813b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.496958:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a0813b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497023:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08134 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497031:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08134 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497038:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08134 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497044:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.497049:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08134 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497056:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08134 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497068:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.497071:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.497075:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08134 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497082:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08134 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497096:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a0813b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497109:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a0813b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497114:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a0813b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497119:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddb400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.497122:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a0813b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497128:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a0813b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497136:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x130f79e0 (ffff97460907ce00) 00010000:00010000:0.0:1784938784.497138:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.497141:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a0813b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497147:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a0813b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497180:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a0812d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bdc expref: 161 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497191:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.497193:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.497197:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a0812d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bdc expref: 161 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.497219:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250600, rc 0) 00000100:00100000:0.0:1784938784.497551:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+160:25037:x1871643326100096:12345-192.168.202.4@tcp:101:cp.0 Request processed in 855us (1338us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.497559:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 167 00000100:00100000:3.0:1784938784.500968:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.501176:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326100224 00000100:00100000:2.0:1784938784.501187:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326100224 00000100:00100000:0.0:1784938784.501434:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 168 00000100:00100000:0.0:1784938784.501444:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+160:25037:x1871643326100224:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.501467:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.501487:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08142 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5be3 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501556:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08149 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501571:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08149 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501584:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08149 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501598:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08150 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501606:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501612:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501705:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08149 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501713:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08149 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501719:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08149 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501725:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.501729:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08149 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501736:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08149 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501768:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.501772:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.501777:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08149 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501784:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08149 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501798:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501804:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08150 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501809:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501824:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.501827:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501833:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08150 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501842:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x130f79e0 (ffff97460907c700) 00010000:00010000:0.0:1784938784.501844:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.501847:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08150 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501853:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08150 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501891:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08142 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5be3 expref: 161 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.501901:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.501904:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.502154:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08142 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5be3 expref: 161 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.502167:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddb800, rc 0) 00000100:00100000:0.0:1784938784.502369:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+160:25037:x1871643326100224:12345-192.168.202.4@tcp:101:cp.0 Request processed in 925us (1409us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.502379:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 168 00000100:00100000:1.0:1784938784.506484:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.506590:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326100480 00000100:00100000:0.0:1784938784.506622:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326100480 00000100:00100000:0.0:1784938784.506685:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 169 00000100:00100000:0.0:1784938784.506695:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+160:25037:x1871643326100480:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.506719:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.506740:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08157 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5bea expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.506900:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0815e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.506930:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0815e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.506943:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0815e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.506959:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a08165 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.506967:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a08165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.506974:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a08165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938784.507735:0:33061:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a:0x0], index 1: 0 00010000:00010000:0.0:1784938784.508163:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddae00/0xcd9d312a94a0816c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.508177:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddae00/0xcd9d312a94a0816c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.508202:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddae00/0xcd9d312a94a0816c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.508381:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0815e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.508390:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0815e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.508397:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0815e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.508404:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.508409:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0815e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.508418:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0815e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.508432:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.508435:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.508440:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0815e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.508447:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0815e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938784.508461:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f30efb55 reply state 000000008045ed9c transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a08165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.508471:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938784.508510:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08157 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bea expref: 163 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.508526:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddae00/0xcd9d312a94a0816c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bea expref: 162 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.508535:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff97460907c300) 00010000:00010000:0.0:1784938784.508537:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938784.508540:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddae00, rc 0) 00000100:00100000:0.0:1784938784.508664:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+163:25037:x1871643326100480:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1969us (2189us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1784938784.508674:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 169 00000100:00100000:1.0:1784938784.514510:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.514682:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326100608 00000100:00100000:0.0:1784938784.514694:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326100608 00000100:00100000:0.0:1784938784.514782:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 110 00000100:00100000:0.0:1784938784.514793:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10023:x1871643326100608:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.514818:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.514843:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f44c0931/0xcd9d312a94a0817a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5bf1 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938784.514874:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938784.514896:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=938s v=(0 0) 00010000:00010000:0.0:1784938784.514901:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.514925:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f44c0931/0xcd9d312a94a0817a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf1 expref: 58 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.514945:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f44c0931/0xcd9d312a94a0817a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf1 expref: 58 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.514978:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddb400, rc 0) 00000100:00100000:0.0:1784938784.515033:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10023:x1871643326100608:12345-192.168.202.4@tcp:101:cp.0 Request processed in 242us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.515041:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 110 00010000:00010000:2.0:1784938784.518192:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a08165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.518211:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a08165 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.518219:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a08165 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.518234:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddac00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.518239:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a08165 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.518255:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a08165 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.518274:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x130f79e0 (ffff97460907c100) 00010000:00010000:2.0:1784938784.518386:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.518392:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a08165 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.518399:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a08165 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x130f79e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.519413:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.519515:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326100736 00000100:00100000:1.0:1784938784.519525:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326100736 00000100:00100000:1.0:1784938784.519911:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 111 00000100:00100000:1.0:1784938784.519921:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:25037:x1871643326100736:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938784.519938:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938784.519958:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000144632bd/0xcd9d312a94a08181 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5bf8 expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.519999:0:33065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f44c0931/0xcd9d312a94a0817a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf1 expref: 59 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.520008:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938784.520013:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938784.520017:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000144632bd/0xcd9d312a94a08181 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf8 expref: 59 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.520053:0:33065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f44c0931/0xcd9d312a94a0817a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf1 expref: 59 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.520067:0:33065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f44c0931/0xcd9d312a94a0817a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf1 expref: 59 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938784.520081:0:33065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735400e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342554496:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938784.520171:0:33065:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747061f1840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938784.527445:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.527565:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326100864 00000100:00100000:3.0:1784938784.527575:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326100864 00010000:00010000:3.0:1784938784.527623:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f44c0931/0xcd9d312a94a0817a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf1 expref: 60 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.527691:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:3.0:1784938784.527702:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703411c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:10024:x1871643326100864:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938784.527720:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938784.527781:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f44c0931/0xcd9d312a94a0817a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf1 expref: 60 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.527798:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f44c0931/0xcd9d312a94a0817a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf1 expref: 60 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.527831:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.527835:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.527845:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000144632bd/0xcd9d312a94a08181 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf8 expref: 60 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.527857:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000144632bd/0xcd9d312a94a08181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf8 expref: 60 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.527898:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000144632bd/0xcd9d312a94a08181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf8 expref: 60 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.527926:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704026a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342554624:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938784.528006:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce6000 going to sleep for 11 seconds 00010000:00010000:0.0:1784938784.528448:0:33065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f44c0931/0xcd9d312a94a0817a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf1 expref: 60 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.528464:0:33065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735400e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342554496:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938784.528492:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000144632bd/0xcd9d312a94a08181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf8 expref: 59 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.528503:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974735f29e00, rc 0) 00000100:00100000:0.0:1784938784.528536:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:25037:x1871643326100736:12345-192.168.202.4@tcp:101:cp.0 Request processed in 8617us (9129us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.528544:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 111 00000100:00100000:2.0:1784938784.532471:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.532602:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704026a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342554624:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938784.532647:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938784.532707:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703411c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10024:x1871643326100864:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5006us (5272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.532720:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:0.0:1784938784.533147:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326101120 00000100:00100000:0.0:1784938784.533156:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326101120 00000100:00100000:0.0:1784938784.533213:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:0.0:1784938784.533232:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+162:25037:x1871643326101120:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938784.533650:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+163:25037:x1871643326101120:12345-192.168.202.4@tcp:35:cp.0 Request processed in 428us (1188us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1784938784.533659:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:2.0:1784938784.538868:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.539042:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326101248 00000100:00100000:0.0:1784938784.539053:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326101248 00000100:00100000:0.0:1784938784.539118:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 170 00000100:00100000:0.0:1784938784.539128:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+163:25037:x1871643326101248:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.539152:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.539174:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a08188 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5bff expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539260:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0818f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539275:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0818f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539285:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0818f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539401:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539408:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539414:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539490:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0818f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539499:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0818f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539526:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0818f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539533:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddb800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.539538:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0818f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539546:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0818f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539559:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.539562:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.539567:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0818f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539573:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0818f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539587:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539594:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08196 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539600:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539605:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.539607:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539625:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539634:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc735cef4 (ffff97460907c700) 00010000:00010000:0.0:1784938784.539636:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.539639:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08196 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539645:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539683:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a08188 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bff expref: 164 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539694:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.539696:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.539700:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a08188 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bff expref: 164 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.539710:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602dda800, rc 0) 00000100:00100000:0.0:1784938784.539804:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+163:25037:x1871643326101248:12345-192.168.202.4@tcp:101:cp.0 Request processed in 677us (945us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.539811:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 170 00000100:00100000:3.0:1784938784.543962:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.544148:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326101376 00000100:00100000:0.0:1784938784.544159:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326101376 00000100:00100000:0.0:1784938784.544216:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 171 00000100:00100000:0.0:1784938784.544239:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+163:25037:x1871643326101376:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.544284:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.544320:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0819d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c06 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544394:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544411:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544423:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544437:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544444:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544451:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544527:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544536:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544543:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544550:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.544562:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544570:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544584:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.544587:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.544593:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544599:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544616:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544623:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544628:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544633:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddb000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.544636:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544642:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544650:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc735cef4 (ffff97460907c200) 00010000:00010000:0.0:1784938784.544653:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.544662:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544669:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544703:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0819d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c06 expref: 164 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544714:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.544716:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.544720:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0819d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c06 expref: 164 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.544729:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddbc00, rc 0) 00000100:00100000:0.0:1784938784.544819:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+163:25037:x1871643326101376:12345-192.168.202.4@tcp:101:cp.0 Request processed in 593us (866us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.544827:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 171 00000100:00100000:2.0:1784938784.549867:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.550064:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326101632 00000100:00100000:1.0:1784938784.550075:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326101632 00000100:00100000:1.0:1784938784.550142:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 172 00000100:00100000:1.0:1784938784.550152:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+163:25037:x1871643326101632:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938784.550176:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938784.550201:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a081b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c0d expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.550359:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a081b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.550387:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a081b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.550400:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a081b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.550417:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a081c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.550425:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a081c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.550432:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a081c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938784.550962:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b:0x0], index 0: 0 00010000:00010000:1.0:1784938784.551123:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ba00/0xcd9d312a94a081c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.551135:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ba00/0xcd9d312a94a081c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.551144:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ba00/0xcd9d312a94a081c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.551179:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a081b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.551186:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a081b9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.551192:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a081b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.551205:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.551209:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a081b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.551217:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a081b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.551240:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938784.551244:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.551249:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a081b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.551255:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28600/0xcd9d312a94a081b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938784.551267:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005456c32e reply state 0000000081542c11 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a081c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938784.551276:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938784.551306:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29000/0xcd9d312a94a081b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c0d expref: 166 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.551321:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ba00/0xcd9d312a94a081c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c0d expref: 165 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.551329:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff974707d24000) 00010000:00010000:1.0:1784938784.551332:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938784.551334:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290ba00, rc 0) 00000100:00100000:1.0:1784938784.551410:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+166:25037:x1871643326101632:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1258us (1552us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1784938784.551424:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 172 00010000:00010000:0.0:1784938784.554825:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a081c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.554844:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a081c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.554851:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a081c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.554857:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.554861:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a081c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.554888:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a081c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.554905:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc735cef4 (ffff97473a027700) 00010000:00010000:0.0:1784938784.554908:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.554912:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a081c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.554919:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a081c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc735cef4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.557074:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.557154:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326101760 00000100:00100000:0.0:1784938784.557165:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326101760 00000100:00100000:0.0:1784938784.557235:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 112 00000100:00100000:0.0:1784938784.557253:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+30:10025:x1871643326101760:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.557273:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.557302:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a081d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c14 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938784.557328:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938784.557349:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=938s v=(0 0) 00010000:00010000:0.0:1784938784.557354:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.557363:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a081d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c14 expref: 31 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.557381:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a081d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c14 expref: 31 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.557417:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddbc00, rc 0) 00000100:00100000:0.0:1784938784.557488:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:10025:x1871643326101760:12345-192.168.202.4@tcp:101:cp.0 Request processed in 244us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.557495:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 112 00000100:00100000:2.0:1784938784.561742:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.561937:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326101888 00000100:00100000:3.0:1784938784.561948:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326101888 00000100:00100000:3.0:1784938784.562006:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:3.0:1784938784.562017:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:25037:x1871643326101888:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.562037:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938784.562060:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a081dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c1b expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.562098:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a081d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c14 expref: 32 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.562107:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.562112:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.562117:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a081dc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c1b expref: 32 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.562152:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a081d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c14 expref: 32 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.562167:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a081d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c14 expref: 32 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.562206:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342554752:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938784.562342:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce6000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938784.567213:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342554752:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938784.567276:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a081dc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c1b expref: 32 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.567306:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209a000, rc 0) 00000100:00100000:3.0:1784938784.567370:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:25037:x1871643326101888:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5355us (5639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.567379:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:2.0:1784938784.570578:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.570697:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326102016 00000100:00100000:0.0:1784938784.570707:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326102016 00010000:00010000:0.0:1784938784.570784:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a081d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c14 expref: 32 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.570824:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:0.0:1784938784.570834:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703410e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:10025:x1871643326102016:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938784.570849:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938784.570874:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a081d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c14 expref: 32 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.570888:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a081d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c14 expref: 32 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.570912:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a081d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c14 expref: 32 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.570932:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.570937:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.570947:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a081dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c1b expref: 31 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.570978:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a081dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c1b expref: 31 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.571021:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a081dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c1b expref: 31 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.571036:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342554880:192.168.202.4@tcp:105: 00000100:00100000:0.0:1784938784.571111:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938784.576517:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.576652:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342554880:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938784.576685:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938784.576787:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703410e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:10025:x1871643326102016:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5954us (6220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.576799:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:1.0:1784938784.576896:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326102272 00000100:00100000:1.0:1784938784.576904:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326102272 00000100:00100000:1.0:1784938784.576960:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:1.0:1784938784.576969:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705cdac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+165:25037:x1871643326102272:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:1.0:1784938784.577338:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705cdac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+166:25037:x1871643326102272:12345-192.168.202.4@tcp:35:cp.0 Request processed in 369us (832us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1784938784.577345:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:1.0:1784938784.582375:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.583088:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326102400 00000100:00100000:0.0:1784938784.583099:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326102400 00000100:00100000:0.0:1784938784.583277:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 173 00000100:00100000:0.0:1784938784.583297:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+166:25037:x1871643326102400:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.583324:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.583347:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a081e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c22 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583447:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583462:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583482:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583498:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583505:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583511:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583576:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583583:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583589:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583594:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddb000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.583599:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583607:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583618:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.583621:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.583625:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583637:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a081ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583652:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583658:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583663:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583668:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.583671:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583677:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583684:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x21aa2247 (ffff97460907c400) 00010000:00010000:0.0:1784938784.583687:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.583690:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583695:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda600/0xcd9d312a94a081f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583729:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a081e3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c22 expref: 167 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583803:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.583806:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.583811:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a081e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c22 expref: 167 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.583822:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddbc00, rc 0) 00000100:00100000:0.0:1784938784.583883:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+166:25037:x1871643326102400:12345-192.168.202.4@tcp:101:cp.0 Request processed in 596us (1517us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.583891:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 173 00000100:00100000:2.0:1784938784.586794:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.587273:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326102528 00000100:00100000:1.0:1784938784.587282:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326102528 00000100:00100000:1.0:1784938784.587342:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:1.0:1784938784.587350:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+166:25037:x1871643326102528:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938784.587368:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938784.587388:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a081f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c29 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587449:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a081ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587463:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a081ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587474:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a081ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587503:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08206 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587514:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587521:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587583:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a081ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587590:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a081ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587596:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a081ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587602:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290aa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.587606:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a081ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587613:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a081ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587623:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938784.587626:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.587630:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a081ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587643:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a081ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587655:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587665:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08206 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587671:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08206 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587675:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.587678:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08206 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587684:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08206 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587691:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x21aa2247 (ffff974702d24a00) 00010000:00010000:1.0:1784938784.587693:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.587695:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08206 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587701:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08206 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587729:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a081f8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c29 expref: 167 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587738:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938784.587740:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.587744:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a081f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c29 expref: 167 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.587783:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a000, rc 0) 00000100:00100000:1.0:1784938784.587834:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+166:25037:x1871643326102528:12345-192.168.202.4@tcp:101:cp.0 Request processed in 485us (1083us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938784.587841:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:1.0:1784938784.592199:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.592464:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326102784 00000100:00100000:0.0:1784938784.592473:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326102784 00000100:00100000:0.0:1784938784.592532:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 175 00000100:00100000:0.0:1784938784.592542:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+166:25037:x1871643326102784:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.592564:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.592585:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0820d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c30 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.592715:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08214 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.592732:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08214 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.592743:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08214 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.592871:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0821b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.592894:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0821b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.592903:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0821b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938784.594115:0:33061:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b:0x0], index 1: 0 00010000:00010000:0.0:1784938784.594335:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a08222 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.594348:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a08222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.594358:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a08222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.594393:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08214 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.594400:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08214 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.594406:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08214 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.594412:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.594417:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08214 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.594424:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08214 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.594452:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.594455:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.594459:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08214 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.594466:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08214 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938784.594480:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004e97c42e reply state 0000000042803dd7 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0821b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.594490:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938784.594528:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0820d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c30 expref: 169 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.594543:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a08222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c30 expref: 168 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.594551:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff97460907c000) 00010000:00010000:0.0:1784938784.594553:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938784.594555:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddb400, rc 0) 00000100:00100000:0.0:1784938784.594630:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+169:25037:x1871643326102784:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2089us (2440us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1784938784.594640:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 175 00000100:00100000:3.0:1784938784.598691:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1784938784.598937:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0821b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.598950:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0821b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.598958:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0821b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.598965:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddb800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.598970:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0821b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.598979:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0821b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.599019:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x21aa2247 (ffff97460907c800) 00010000:00010000:2.0:1784938784.599022:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.599027:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0821b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.599034:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a0821b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x21aa2247 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.599600:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326102912 00000100:00100000:0.0:1784938784.599613:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326102912 00000100:00100000:0.0:1784938784.599672:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:0.0:1784938784.599683:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10023:x1871643326102912:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.599714:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.599736:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a034279/0xcd9d312a94a08230 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c37 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938784.599791:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938784.599809:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=938s v=(0 0) 00010000:00010000:0.0:1784938784.599813:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.599822:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a034279/0xcd9d312a94a08230 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c37 expref: 59 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.599840:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a034279/0xcd9d312a94a08230 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c37 expref: 59 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.599854:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602dda000, rc 0) 00000100:00100000:0.0:1784938784.599924:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:10023:x1871643326102912:12345-192.168.202.4@tcp:101:cp.0 Request processed in 244us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.599933:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:2.0:1784938784.603432:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.603574:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326103040 00000100:00100000:0.0:1784938784.603584:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326103040 00000100:00100000:0.0:1784938784.603641:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 115 00000100:00100000:0.0:1784938784.603651:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:25037:x1871643326103040:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.603671:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.603690:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002edb92e1/0xcd9d312a94a08237 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c3e expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.603724:0:33065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a034279/0xcd9d312a94a08230 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c37 expref: 60 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.603792:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.603797:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.603805:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002edb92e1/0xcd9d312a94a08237 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c3e expref: 60 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.603840:0:33065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a034279/0xcd9d312a94a08230 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c37 expref: 60 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.603855:0:33065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a034279/0xcd9d312a94a08230 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c37 expref: 60 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.603869:0:33065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342555008:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938784.603946:0:33065:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747055c9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938784.608080:0:33065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342555008:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938784.608117:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002edb92e1/0xcd9d312a94a08237 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c3e expref: 60 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.608140:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602dda600, rc 0) 00000100:00100000:0.0:1784938784.608203:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:25037:x1871643326103040:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4551us (4779us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.608213:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 115 00000100:00100000:1.0:1784938784.610419:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.610582:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326103168 00000100:00100000:3.0:1784938784.610593:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326103168 00010000:00010000:3.0:1784938784.610633:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a034279/0xcd9d312a94a08230 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c37 expref: 60 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.610673:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:3.0:1784938784.610683:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:10024:x1871643326103168:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938784.610700:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938784.610723:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a034279/0xcd9d312a94a08230 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c37 expref: 60 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.610739:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a034279/0xcd9d312a94a08230 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c37 expref: 60 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.610821:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a034279/0xcd9d312a94a08230 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c37 expref: 60 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.610841:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.610845:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.610854:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002edb92e1/0xcd9d312a94a08237 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c3e expref: 59 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.610865:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002edb92e1/0xcd9d312a94a08237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c3e expref: 59 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.610916:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002edb92e1/0xcd9d312a94a08237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c3e expref: 59 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.610934:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342555136:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938784.611021:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce6000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938784.613429:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342555136:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938784.613456:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938784.613519:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:10024:x1871643326103168:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2836us (3107us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.613530:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:1.0:1784938784.621360:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.621466:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326103424 00000100:00100000:0.0:1784938784.621475:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326103424 00000100:00100000:0.0:1784938784.621541:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:0.0:1784938784.621568:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+168:25037:x1871643326103424:12345-192.168.202.4@tcp:35:cp.0 00000001:00080000:0.0:1784938784.621879:0:30633:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1784938784.621979:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+170:25037:x1871643326103424:12345-192.168.202.4@tcp:35:cp.0 Request processed in 413us (627us total) trans 4294967405 rc 0/0 00000100:00100000:0.0:1784938784.621987:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 53 00000020:00080000:0.0:1784938784.621992:0:30633:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784938784.626258:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.626405:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326103552 00000100:00100000:0.0:1784938784.626417:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326103552 00000100:00100000:0.0:1784938784.626513:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 176 00000100:00100000:0.0:1784938784.626525:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+170:25037:x1871643326103552:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.626550:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.626574:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0823e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c45 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626641:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08245 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626655:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08245 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626667:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08245 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626682:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0824c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626689:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0824c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626694:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0824c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626815:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08245 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626824:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08245 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626830:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08245 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626837:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.626841:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08245 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626849:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08245 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626862:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.626865:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.626870:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08245 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626877:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08245 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626890:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0824c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626896:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0824c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.626903:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0824c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.627079:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.627083:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0824c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.627090:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0824c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.627099:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xbf580d0c (ffff97460907c400) 00010000:00010000:0.0:1784938784.627102:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.627105:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0824c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.627112:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0824c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.627146:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0823e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c45 expref: 171 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.627156:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.627159:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.627162:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a0823e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c45 expref: 171 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.627172:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602dda800, rc 0) 00000100:00100000:2.0:1784938784.628090:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+170:25037:x1871643326103552:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1564us (1844us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.628100:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 176 00000100:00100000:1.0:1784938784.631421:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.633164:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326103680 00000100:00100000:2.0:1784938784.633177:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326103680 00000100:00100000:2.0:1784938784.633520:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 177 00000100:00100000:2.0:1784938784.633534:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+170:25037:x1871643326103680:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.633558:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.633585:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08253 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c4c expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633664:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0825a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633679:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0825a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633690:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0825a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633728:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08261 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633736:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633743:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633830:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0825a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633838:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0825a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633844:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0825a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633850:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.633855:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0825a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633862:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0825a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633875:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.633879:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.633883:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0825a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633889:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a0825a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633924:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633931:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08261 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633937:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08261 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633941:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.633945:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08261 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633950:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08261 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633958:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xbf580d0c (ffff97473e984500) 00010000:00010000:2.0:1784938784.633961:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.633963:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08261 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.633968:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08261 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.634001:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08253 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c4c expref: 171 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.634012:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.634014:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.634025:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08253 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c4c expref: 171 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.634035:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460924f400, rc 0) 00000100:00100000:2.0:1784938784.634109:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+170:25037:x1871643326103680:12345-192.168.202.4@tcp:101:cp.0 Request processed in 578us (2697us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.634117:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 177 00000100:00100000:1.0:1784938784.638728:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.638851:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326103936 00000100:00100000:3.0:1784938784.638863:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326103936 00000100:00100000:3.0:1784938784.638924:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 178 00000100:00100000:3.0:1784938784.638950:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+170:25037:x1871643326103936:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.638972:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938784.638993:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a08268 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c53 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.639132:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a0826f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.639148:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a0826f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.639160:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a0826f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.639175:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08276 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.639183:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.639190:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938784.639882:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c:0x0], index 0: 0 00010000:00010000:3.0:1784938784.640049:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a0827d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.640060:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a0827d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.640069:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a0827d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.640127:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a0826f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.640134:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a0826f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.640140:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a0826f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.640146:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209ae00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938784.640151:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a0826f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.640159:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a0826f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.640171:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938784.640174:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938784.640178:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a0826f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.640184:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a0826f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938784.640196:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000875520db reply state 000000003c830124 transno 4294967406 ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.640205:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938784.640694:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b800/0xcd9d312a94a08268 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c53 expref: 173 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.640728:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a0827d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c53 expref: 172 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.640735:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff97471360e700) 00010000:00010000:3.0:1784938784.640738:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938784.640740:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209b600, rc 0) 00000100:00100000:3.0:1784938784.641113:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+173:25037:x1871643326103936:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2163us (2393us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1784938784.641122:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 178 00000100:00100000:1.0:1784938784.646514:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1784938784.647042:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.647055:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08276 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.647082:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08276 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.647089:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209aa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.647094:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08276 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.647102:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08276 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.647119:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xbf580d0c (ffff97471360e600) 00010000:00010000:0.0:1784938784.647122:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.647127:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08276 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.647133:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08276 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbf580d0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.647296:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326104064 00000100:00100000:3.0:1784938784.647306:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326104064 00000100:00100000:3.0:1784938784.647361:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 116 00000100:00100000:3.0:1784938784.647370:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+31:10025:x1871643326104064:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.647389:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938784.647409:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a0828b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c5a expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938784.647436:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938784.647456:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=938s v=(0 0) 00010000:00010000:3.0:1784938784.647461:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.647471:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a0828b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c5a expref: 32 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.647490:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a0828b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c5a expref: 32 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.647521:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209a800, rc 0) 00000100:00100000:3.0:1784938784.647585:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:10025:x1871643326104064:12345-192.168.202.4@tcp:101:cp.0 Request processed in 215us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.647592:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 116 00000100:00100000:1.0:1784938784.651338:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.651460:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326104192 00000100:00100000:3.0:1784938784.651470:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326104192 00000100:00100000:3.0:1784938784.651529:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 117 00000100:00100000:3.0:1784938784.651538:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974607d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:25037:x1871643326104192:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.651557:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938784.651576:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a08292 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c61 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.651608:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a0828b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c5a expref: 33 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.651618:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.651623:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.651629:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a08292 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c61 expref: 33 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.651662:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a0828b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c5a expref: 33 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.651677:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a0828b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c5a expref: 33 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.651704:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342555264:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938784.651809:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce6180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938784.658962:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.659078:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342555264:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938784.659112:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a08292 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c61 expref: 33 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.659135:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209b800, rc 0) 00000100:00100000:3.0:1784938784.659197:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974607d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:25037:x1871643326104192:12345-192.168.202.4@tcp:101:cp.0 Request processed in 7659us (7867us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.659206:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 117 00000100:00100000:0.0:1784938784.659423:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326104320 00000100:00100000:0.0:1784938784.659430:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326104320 00010000:00010000:0.0:1784938784.659463:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a0828b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c5a expref: 33 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.659499:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:0.0:1784938784.659508:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:10025:x1871643326104320:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938784.659522:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938784.659546:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a0828b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c5a expref: 33 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.659581:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a0828b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c5a expref: 33 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.659605:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a0828b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c5a expref: 33 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.659619:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.659623:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.659631:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a08292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c61 expref: 32 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.659642:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a08292 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c61 expref: 32 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.659680:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a08292 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c61 expref: 32 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.659695:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342555392:192.168.202.4@tcp:105: 00000100:00100000:0.0:1784938784.659746:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974603cc13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938784.664096:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.664180:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326104576 00000100:00100000:2.0:1784938784.664189:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326104576 00000100:00100000:2.0:1784938784.664287:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:2.0:1784938784.664306:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+172:25037:x1871643326104576:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:2.0:1784938784.664678:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+173:25037:x1871643326104576:12345-192.168.202.4@tcp:35:cp.0 Request processed in 374us (591us total) trans 4294967407 rc 0/0 00000100:00100000:2.0:1784938784.664687:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:0.0:1784938784.665177:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342555392:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938784.665204:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938784.665245:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:10025:x1871643326104320:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5738us (6293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.665255:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:1.0:1784938784.669953:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.670270:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326104704 00000100:00100000:0.0:1784938784.670281:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326104704 00000100:00100000:0.0:1784938784.670354:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 179 00000100:00100000:0.0:1784938784.670364:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+173:25037:x1871643326104704:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.670389:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.670411:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a08299 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c68 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670503:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a082a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670519:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a082a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670529:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a082a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670543:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a082a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670550:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a082a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670557:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a082a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670626:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a082a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670635:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a082a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670664:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a082a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670671:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.670676:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a082a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670685:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a082a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670698:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.670701:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.670705:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a082a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670712:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a082a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670727:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a082a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670734:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a082a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670740:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a082a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.670745:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.671152:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a082a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.671173:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a082a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.671184:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe3541c1d (ffff97460907c400) 00010000:00010000:0.0:1784938784.671186:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.671189:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a082a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.671195:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a082a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.671242:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a08299 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c68 expref: 174 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.671253:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.671255:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.671259:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a08299 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c68 expref: 174 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.671269:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602dda800, rc 0) 00000100:00100000:0.0:1784938784.671387:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+173:25037:x1871643326104704:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1023us (1443us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.671395:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 179 00000100:00100000:1.0:1784938784.675560:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.675679:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326104832 00000100:00100000:2.0:1784938784.675690:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326104832 00000100:00100000:2.0:1784938784.676051:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 180 00000100:00100000:2.0:1784938784.676064:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+173:25037:x1871643326104832:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.676089:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.676116:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a082ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c6f expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676182:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a082b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676197:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a082b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676243:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a082b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676269:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a082bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676278:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a082bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676351:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a082bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676419:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a082b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676428:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a082b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676435:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a082b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676442:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.676447:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a082b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676456:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a082b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676470:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.676473:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.676479:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a082b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676492:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a082b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676507:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a082bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676514:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a082bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676519:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a082bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676525:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.676528:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a082bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676534:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a082bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676542:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe3541c1d (ffff97473e984500) 00010000:00010000:2.0:1784938784.676544:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.676548:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a082bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676553:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a082bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676590:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a082ae lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c6f expref: 174 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676613:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.676615:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.676619:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a082ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c6f expref: 174 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.676628:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e00600, rc 0) 00000100:00100000:2.0:1784938784.676741:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+173:25037:x1871643326104832:12345-192.168.202.4@tcp:101:cp.0 Request processed in 679us (1189us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.676818:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 180 00000100:00100000:1.0:1784938784.680703:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.680904:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326105088 00000100:00100000:2.0:1784938784.680974:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326105088 00000100:00100000:2.0:1784938784.681079:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 181 00000100:00100000:2.0:1784938784.681091:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+173:25037:x1871643326105088:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.681113:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.681138:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a082c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c76 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.681483:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a082ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.681500:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a082ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.681512:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a082ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.681528:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a082d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.681551:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a082d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.681559:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a082d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938784.682126:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c:0x0], index 1: 0 00010000:00010000:2.0:1784938784.682476:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892a00/0xcd9d312a94a082d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.682490:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892a00/0xcd9d312a94a082d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.682498:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892a00/0xcd9d312a94a082d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.682538:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a082ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.682546:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a082ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.682553:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a082ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.682559:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.682564:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a082ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.682570:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a082ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.682598:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.682601:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.682605:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a082ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.682612:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04200/0xcd9d312a94a082ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938784.682626:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dd796857 reply state 000000000de28564 transno 4294967408 ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a082d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.682635:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938784.682672:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a082c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c76 expref: 176 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.682686:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892a00/0xcd9d312a94a082d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c76 expref: 175 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.682694:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff974705478500) 00010000:00010000:2.0:1784938784.682697:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938784.682700:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892a00, rc 0) 00000100:00100000:2.0:1784938784.683589:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+176:25037:x1871643326105088:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2495us (2893us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1784938784.683600:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 181 00000100:00100000:2.0:1784938784.690012:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.690235:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326105216 00000100:00100000:3.0:1784938784.690249:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326105216 00000100:00100000:3.0:1784938784.690316:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:3.0:1784938784.690326:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:10023:x1871643326105216:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.690344:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938784.690365:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a082e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c7d expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938784.690391:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938784.690411:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=938s v=(0 0) 00010000:00010000:3.0:1784938784.690416:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.690426:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a082e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c7d expref: 60 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.690465:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a082e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c7d expref: 60 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.690479:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209ae00, rc 0) 00000100:00100000:3.0:1784938784.690548:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:10023:x1871643326105216:12345-192.168.202.4@tcp:101:cp.0 Request processed in 223us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.690557:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:0.0:1784938784.694250:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1784938784.696543:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a082d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.696561:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a082d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.696569:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a082d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.696575:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.696599:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a082d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.696608:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a082d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.696627:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe3541c1d (ffff97473e984e00) 00010000:00010000:1.0:1784938784.696631:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.696637:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a082d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.696643:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a082d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe3541c1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.697392:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326105344 00000100:00100000:2.0:1784938784.697406:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326105344 00000100:00100000:2.0:1784938784.697507:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:2.0:1784938784.697530:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:25037:x1871643326105344:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.697548:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.697565:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a082ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c84 expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.697595:0:33065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a082e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c7d expref: 61 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.697605:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.697609:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.697615:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a082ed lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c84 expref: 61 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.697658:0:33065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a082e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c7d expref: 61 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.697673:0:33065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a082e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c7d expref: 61 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.697688:0:33065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703410e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342555520:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938784.697815:0:33065:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a8223c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938784.705781:0:33065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703410e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342555520:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938784.705821:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a082ed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c84 expref: 61 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.705866:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892c00, rc 0) 00000100:00100000:2.0:1784938784.705915:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:25037:x1871643326105344:12345-192.168.202.4@tcp:101:cp.0 Request processed in 8387us (11691us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938784.705924:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:1.0:1784938784.711340:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.711425:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326105472 00000100:00100000:3.0:1784938784.711437:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326105472 00010000:00010000:3.0:1784938784.711485:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a082e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c7d expref: 61 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.711536:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:3.0:1784938784.711547:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:10024:x1871643326105472:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938784.711562:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938784.711588:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a082e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c7d expref: 61 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.711605:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a082e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c7d expref: 61 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.711632:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047e537ea/0xcd9d312a94a082e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c7d expref: 61 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.711671:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.711675:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.711684:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a082ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c84 expref: 60 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.711696:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a082ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c84 expref: 60 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.711734:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a082ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c84 expref: 60 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.711782:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342555648:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938784.711866:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce6180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938784.716603:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342555648:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938784.716634:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938784.716696:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:10024:x1871643326105472:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5151us (5366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.716707:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:0.0:1784938784.721258:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.721427:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326105728 00000100:00100000:2.0:1784938784.721438:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326105728 00000100:00100000:2.0:1784938784.721497:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:2.0:1784938784.721507:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+175:25037:x1871643326105728:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:2.0:1784938784.721916:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+176:25037:x1871643326105728:12345-192.168.202.4@tcp:35:cp.0 Request processed in 410us (674us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1784938784.721924:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:1.0:1784938784.730578:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.730686:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326105856 00000100:00100000:3.0:1784938784.730697:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326105856 00000100:00100000:3.0:1784938784.730791:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 182 00000100:00100000:3.0:1784938784.730802:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+176:25037:x1871643326105856:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.730827:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938784.730849:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a082f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c8b expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.730929:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a082fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.730944:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a082fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.730957:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a082fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.730972:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a08302 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.730980:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a08302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.730987:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a08302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731118:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a082fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731127:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a082fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731134:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a082fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731140:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938784.731145:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a082fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731163:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a082fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731176:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938784.731179:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938784.731184:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a082fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731191:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a082fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731204:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a08302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731210:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a08302 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731216:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a08302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731232:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938784.731234:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a08302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731241:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a08302 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731248:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x89d48c8d (ffff9747052c8100) 00010000:00010000:3.0:1784938784.731251:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938784.731253:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a08302 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.731269:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a800/0xcd9d312a94a08302 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.732659:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a082f4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c8b expref: 177 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.732677:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938784.732679:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938784.732684:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a082f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c8b expref: 177 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.732699:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209ae00, rc 0) 00000100:00100000:0.0:1784938784.733129:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+176:25037:x1871643326105856:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2326us (2558us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.733139:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 182 00000100:00100000:0.0:1784938784.736679:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.736929:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326105984 00000100:00100000:2.0:1784938784.736939:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326105984 00000100:00100000:2.0:1784938784.736998:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 183 00000100:00100000:2.0:1784938784.737007:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+176:25037:x1871643326105984:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.737043:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.737066:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a08309 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c92 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737131:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a08310 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737146:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a08310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737158:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a08310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737188:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08317 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737196:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737203:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737298:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a08310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737307:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a08310 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737314:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a08310 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737321:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.737325:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a08310 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737332:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a08310 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737345:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.737348:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.737353:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a08310 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737359:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a08310 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737380:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737385:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08317 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737390:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737395:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.737398:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737404:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08317 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737412:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x89d48c8d (ffff97473e984e00) 00010000:00010000:2.0:1784938784.737414:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.737417:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08317 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737422:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08317 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737453:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a08309 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c92 expref: 177 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737464:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.737465:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.737476:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a08309 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c92 expref: 177 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.737487:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893c00, rc 0) 00000100:00100000:2.0:1784938784.738336:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+176:25037:x1871643326105984:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1325us (1662us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.738347:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 183 00000100:00100000:2.0:1784938784.746201:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938784.746336:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326106240 00000100:00100000:1.0:1784938784.746348:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326106240 00000100:00100000:1.0:1784938784.746418:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 184 00000100:00100000:1.0:1784938784.746429:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+176:25037:x1871643326106240:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938784.746455:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938784.746480:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a0831e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5c99 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.746638:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08325 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.746656:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08325 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.746670:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08325 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.746702:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0832c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.746710:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0832c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.746717:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0832c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938784.749949:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d:0x0], index 0: 0 00010000:00010000:0.0:1784938784.750383:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddba00/0xcd9d312a94a08333 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.750402:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddba00/0xcd9d312a94a08333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.750416:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddba00/0xcd9d312a94a08333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.750461:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08325 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.750469:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08325 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.750476:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08325 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.750482:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290aa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.750487:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08325 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.750496:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08325 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.750509:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.750512:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.750516:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08325 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.750524:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08325 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938784.750551:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d819e8fb reply state 000000000b95a37b transno 4294967410 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0832c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.750562:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938784.750603:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a0831e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c99 expref: 179 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.750619:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddba00/0xcd9d312a94a08333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c99 expref: 178 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.750627:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff97460907c400) 00010000:00010000:0.0:1784938784.750630:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938784.750633:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddba00, rc 0) 00000100:00100000:0.0:1784938784.750934:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+179:25037:x1871643326106240:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4505us (4743us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1784938784.750944:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 184 00000100:00100000:0.0:1784938784.756321:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.756512:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326106368 00000100:00100000:3.0:1784938784.756523:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326106368 00000100:00100000:3.0:1784938784.756580:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:3.0:1784938784.756589:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+32:10025:x1871643326106368:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.756607:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938784.756628:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a08341 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ca0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938784.756657:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938784.756682:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=938s v=(0 0) 00010000:00010000:3.0:1784938784.756687:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.756696:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a08341 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca0 expref: 33 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.756733:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a08341 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca0 expref: 33 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.756746:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209ae00, rc 0) 00000100:00100000:3.0:1784938784.756828:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:10025:x1871643326106368:12345-192.168.202.4@tcp:101:cp.0 Request processed in 240us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.756835:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:1.0:1784938784.759726:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.759881:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326106496 00000100:00100000:3.0:1784938784.759891:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326106496 00000100:00100000:3.0:1784938784.759952:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:3.0:1784938784.759962:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:25037:x1871643326106496:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.759979:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938784.759999:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08348 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ca7 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.760040:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a08341 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca0 expref: 34 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.760050:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.760054:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.760058:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08348 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca7 expref: 34 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.760093:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a08341 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca0 expref: 34 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.760124:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a08341 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca0 expref: 34 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.760139:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342555776:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938784.760747:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce6180 going to sleep for 11 seconds 00010000:00010000:2.0:1784938784.763359:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0832c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.763377:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0832c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.763385:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0832c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.763390:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.763394:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0832c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.763405:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0832c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.763426:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x89d48c8d (ffff974702d24a00) 00010000:00010000:2.0:1784938784.763429:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.763434:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0832c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.763439:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0832c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x89d48c8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.765893:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342555776:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938784.765929:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08348 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca7 expref: 34 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.765951:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209a800, rc 0) 00000100:00100000:3.0:1784938784.766010:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+34:25037:x1871643326106496:12345-192.168.202.4@tcp:101:cp.0 Request processed in 6048us (6293us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.766020:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:1.0:1784938784.769537:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.769620:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326106624 00000100:00100000:0.0:1784938784.769630:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326106624 00010000:00010000:0.0:1784938784.769672:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a08341 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca0 expref: 34 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.769715:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:0.0:1784938784.769725:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+34:10025:x1871643326106624:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938784.769741:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938784.769798:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a08341 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca0 expref: 34 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.769829:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a08341 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca0 expref: 34 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.769854:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047e537ea/0xcd9d312a94a08341 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca0 expref: 34 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.769870:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.769875:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.769883:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08348 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca7 expref: 33 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.769894:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08348 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca7 expref: 33 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.769929:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08348 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca7 expref: 33 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.769943:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342555904:192.168.202.4@tcp:105: 00000100:00100000:0.0:1784938784.770018:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747104d63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938784.774815:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.774934:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342555904:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938784.774960:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938784.775016:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:10025:x1871643326106624:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5292us (5489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938784.775038:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:3.0:1784938784.775175:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326106880 00000100:00100000:3.0:1784938784.775183:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326106880 00000100:00100000:3.0:1784938784.775251:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:3.0:1784938784.775267:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+178:25037:x1871643326106880:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938784.775591:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+179:25037:x1871643326106880:12345-192.168.202.4@tcp:35:cp.0 Request processed in 325us (785us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1784938784.775598:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:1.0:1784938784.783861:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.783961:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326107008 00000100:00100000:0.0:1784938784.783972:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326107008 00000100:00100000:0.0:1784938784.784044:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 185 00000100:00100000:0.0:1784938784.784054:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+179:25037:x1871643326107008:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.784079:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.784116:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb200/0xcd9d312a94a0834f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5cae expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784204:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08356 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784218:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784241:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784257:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0835d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784265:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0835d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784271:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0835d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784348:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784356:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08356 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784364:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08356 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784371:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddaa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.784375:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08356 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784393:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08356 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784406:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.784409:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.784414:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08356 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784421:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08356 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784434:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0835d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784440:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0835d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784447:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0835d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784453:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbe00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.784455:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0835d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784461:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0835d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784468:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa38d6329 (ffff97460907c800) 00010000:00010000:0.0:1784938784.784470:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.784473:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0835d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784488:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0835d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784521:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb200/0xcd9d312a94a0834f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cae expref: 180 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784531:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.784534:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.784538:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb200/0xcd9d312a94a0834f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cae expref: 180 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.784547:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddb200, rc 0) 00000100:00100000:0.0:1784938784.784609:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+179:25037:x1871643326107008:12345-192.168.202.4@tcp:101:cp.0 Request processed in 556us (758us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.784617:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 185 00000100:00100000:1.0:1784938784.787471:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.787572:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326107136 00000100:00100000:0.0:1784938784.787591:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326107136 00000100:00100000:0.0:1784938784.787788:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 186 00000100:00100000:0.0:1784938784.787801:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+179:25037:x1871643326107136:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.787822:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.787844:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a08364 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5cb5 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.787908:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0836b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.787922:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0836b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.787947:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0836b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.787965:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08372 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.787972:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.787980:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788056:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0836b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788063:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0836b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788069:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0836b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788075:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.788080:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0836b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788087:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0836b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788099:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.788102:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.788108:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0836b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788125:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0836b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788140:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788161:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08372 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788166:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788172:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.788175:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788181:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08372 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788190:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa38d6329 (ffff97473a027700) 00010000:00010000:0.0:1784938784.788192:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.788195:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08372 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788201:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08372 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788246:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a08364 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cb5 expref: 180 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788271:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.788273:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.788278:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb000/0xcd9d312a94a08364 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cb5 expref: 180 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.788288:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddb000, rc 0) 00000100:00100000:0.0:1784938784.788366:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+179:25037:x1871643326107136:12345-192.168.202.4@tcp:101:cp.0 Request processed in 567us (912us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.788374:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 186 00000100:00100000:1.0:1784938784.792089:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.792234:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326107392 00000100:00100000:0.0:1784938784.792246:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326107392 00000100:00100000:0.0:1784938784.792306:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 187 00000100:00100000:0.0:1784938784.792316:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+179:25037:x1871643326107392:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.792337:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.792357:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a08379 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5cbc expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.792496:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08380 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.792514:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08380 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.792528:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08380 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.792546:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08387 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.792574:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.792582:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938784.794557:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d:0x0], index 1: 0 00010000:00010000:0.0:1784938784.796219:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a0838e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.796249:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a0838e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.796261:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a0838e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.796304:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08380 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.796312:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08380 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.796320:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08380 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.796327:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.796332:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08380 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.796340:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08380 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.796372:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.796375:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.796380:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08380 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.796387:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08380 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938784.796404:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046be20c4 reply state 0000000082f18bf6 transno 4294967412 ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.796414:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938784.796734:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda800/0xcd9d312a94a08379 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cbc expref: 182 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.796801:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a0838e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cbc expref: 181 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.796811:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff974609f5de00) 00010000:00010000:0.0:1784938784.796814:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938784.796816:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddac00, rc 0) 00000100:00100000:1.0:1784938784.798958:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+182:25037:x1871643326107392:12345-192.168.202.4@tcp:101:cp.0 Request processed in 6631us (6867us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1784938784.798973:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 187 00000100:00100000:1.0:1784938784.803854:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1784938784.803986:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.804001:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08387 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.804010:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08387 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.804017:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddb800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.804031:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08387 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.804040:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08387 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.804059:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa38d6329 (ffff974609f5d300) 00010000:00010000:2.0:1784938784.804062:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.804068:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08387 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.804075:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08387 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xa38d6329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.804636:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326107520 00000100:00100000:3.0:1784938784.804656:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326107520 00000100:00100000:3.0:1784938784.805099:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:3.0:1784938784.805451:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:10023:x1871643326107520:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.805497:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938784.805537:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0839c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5cc3 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938784.805577:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938784.805603:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=938s v=(0 0) 00010000:00010000:3.0:1784938784.805609:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.805621:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0839c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cc3 expref: 61 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.805642:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0839c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cc3 expref: 61 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.805659:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209a400, rc 0) 00000100:00100000:3.0:1784938784.805815:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:10023:x1871643326107520:12345-192.168.202.4@tcp:101:cp.0 Request processed in 704us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.805825:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:1.0:1784938784.831168:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.831286:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326107648 00000100:00100000:0.0:1784938784.831297:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326107648 00000100:00100000:0.0:1784938784.831367:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:0.0:1784938784.831378:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:25037:x1871643326107648:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.831397:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.831418:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f3cb62a/0xcd9d312a94a083a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5cca expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.831477:0:33065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0839c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cc3 expref: 62 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.831486:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.831490:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.831495:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f3cb62a/0xcd9d312a94a083a3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->118783] (req 0->118783) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cca expref: 62 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.831530:0:33065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0839c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cc3 expref: 62 pid: 31428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.831557:0:33065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0839c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cc3 expref: 62 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.831573:0:33065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97472a1eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342556032:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938784.831665:0:33065:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747104d63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938784.837237:0:33065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97472a1eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342556032:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938784.837276:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000f3cb62a/0xcd9d312a94a083a3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->118783] (req 0->118783) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cca expref: 62 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.837300:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602dda800, rc 0) 00000100:00100000:0.0:1784938784.837367:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:25037:x1871643326107648:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5989us (6208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.837377:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:1.0:1784938784.837543:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.837906:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326107776 00000100:00100000:3.0:1784938784.837915:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326107776 00010000:00010000:3.0:1784938784.837947:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0839c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cc3 expref: 62 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.837982:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:3.0:1784938784.837990:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:10023:x1871643326107776:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938784.838004:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938784.838034:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0839c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cc3 expref: 62 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.838048:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0839c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cc3 expref: 62 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.838070:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0839c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cc3 expref: 62 pid: 31428 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.838084:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.838088:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.838094:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f3cb62a/0xcd9d312a94a083a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cca expref: 61 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.838104:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f3cb62a/0xcd9d312a94a083a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cca expref: 61 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.838139:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000f3cb62a/0xcd9d312a94a083a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cca expref: 61 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.838153:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342556160:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938784.838229:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce6180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938784.844703:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342556160:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938784.844733:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938784.844811:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:10023:x1871643326107776:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6821us (7269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.844844:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:2.0:1784938784.854316:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.856972:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326108032 00000100:00100000:3.0:1784938784.856988:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326108032 00000100:00100000:3.0:1784938784.857070:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:3.0:1784938784.857081:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+181:25037:x1871643326108032:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938784.857492:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+182:25037:x1871643326108032:12345-192.168.202.4@tcp:35:cp.0 Request processed in 411us (3186us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1784938784.857500:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:0.0:1784938784.862825:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.862920:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326108160 00000100:00100000:2.0:1784938784.862932:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326108160 00000100:00100000:2.0:1784938784.862995:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 188 00000100:00100000:2.0:1784938784.863006:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+182:25037:x1871643326108160:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.863032:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.863054:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a083aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5cd1 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863123:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a083b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863139:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a083b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863151:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a083b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863163:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a083b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863170:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a083b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863176:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a083b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863255:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a083b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863281:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a083b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863288:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a083b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863293:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.863297:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a083b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863305:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a083b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863317:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.863320:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.863325:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a083b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863331:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a083b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863345:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a083b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863351:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a083b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863357:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a083b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863363:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.863372:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a083b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863379:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a083b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863388:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xbb599949 (ffff97473e984e00) 00010000:00010000:2.0:1784938784.863391:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.863394:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a083b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863399:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a083b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863432:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a083aa lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cd1 expref: 183 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863443:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.863445:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.863449:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a083aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cd1 expref: 183 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.863458:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893c00, rc 0) 00000100:00100000:2.0:1784938784.863517:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+182:25037:x1871643326108160:12345-192.168.202.4@tcp:101:cp.0 Request processed in 513us (701us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.863524:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 188 00000100:00100000:1.0:1784938784.868170:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.868270:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326108288 00000100:00100000:2.0:1784938784.868281:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326108288 00000100:00100000:2.0:1784938784.868353:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 189 00000100:00100000:2.0:1784938784.868365:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+182:25037:x1871643326108288:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.868402:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.868426:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a083bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5cd8 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868514:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a083c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868529:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a083c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868707:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a083c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868726:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a083cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868733:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a083cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868740:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a083cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868903:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a083c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868911:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a083c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868917:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a083c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868923:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.868934:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a083c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868943:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a083c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868955:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.868958:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.868963:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a083c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868970:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a083c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868983:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a083cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868988:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a083cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868994:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a083cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.868998:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.869001:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a083cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.869006:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a083cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.869013:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xbb599949 (ffff97473e984500) 00010000:00010000:2.0:1784938784.869015:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.869024:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a083cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.869029:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a083cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.869065:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a083bf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cd8 expref: 183 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.869074:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.869077:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.869080:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a083bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cd8 expref: 183 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.869088:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893000, rc 0) 00000100:00100000:2.0:1784938784.869199:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+182:25037:x1871643326108288:12345-192.168.202.4@tcp:101:cp.0 Request processed in 835us (1040us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.869207:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 189 00000100:00100000:1.0:1784938784.878412:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.880490:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326108544 00000100:00100000:2.0:1784938784.880504:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326108544 00000100:00100000:2.0:1784938784.880576:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 190 00000100:00100000:2.0:1784938784.880586:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+182:25037:x1871643326108544:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.880610:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.880632:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a083d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5cdf expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.897861:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a083db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.897880:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a083db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.897891:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a083db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.897909:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a083e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xbb599949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.897916:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a083e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.897922:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a083e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938784.898551:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e:0x0], index 0: 0 00010000:00010000:3.0:1784938784.898736:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a083e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.899602:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a083e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.899614:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a083e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.899694:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a083db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.899702:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a083db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.899708:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a083db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.899715:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938784.899719:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a083db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.899727:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a083db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.899741:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938784.899744:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938784.899748:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a083db lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.899773:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a400/0xcd9d312a94a083db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938784.899786:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c4ff1fd reply state 00000000366a8715 transno 4294967414 ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a083e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.899805:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938784.899850:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a083d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cdf expref: 185 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.899865:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a083e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cdf expref: 184 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.899872:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff97471a350a00) 00010000:00010000:3.0:1784938784.899874:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938784.899877:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209ae00, rc 0) 00000100:00100000:3.0:1784938784.900018:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+185:25037:x1871643326108544:12345-192.168.202.4@tcp:101:cp.0 Request processed in 19433us (21615us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1784938784.900026:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 190 00010000:00010000:2.0:1784938784.907097:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a083e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.907135:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a083e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.907142:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a083e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.907148:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209aa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.907153:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a083e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.907161:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a083e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.907178:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xbb599949 (ffff97471a350600) 00010000:00010000:2.0:1784938784.907181:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.907186:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a083e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.907192:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a083e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbb599949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938784.913117:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.913215:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326108672 00000100:00100000:0.0:1784938784.913234:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326108672 00000100:00100000:0.0:1784938784.913298:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00100000:0.0:1784938784.913309:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+33:10025:x1871643326108672:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.913329:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.913355:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a083f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ce6 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938784.913387:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938784.913409:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=938s v=(0 0) 00010000:00010000:0.0:1784938784.913415:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.913426:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a083f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ce6 expref: 34 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.913447:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a083f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ce6 expref: 34 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.913463:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddbc00, rc 0) 00000100:00100000:0.0:1784938784.913526:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+34:10025:x1871643326108672:12345-192.168.202.4@tcp:101:cp.0 Request processed in 218us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.913544:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00100000:0.0:1784938784.920064:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.921449:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326108800 00000100:00100000:3.0:1784938784.921465:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326108800 00000100:00100000:3.0:1784938784.921558:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:3.0:1784938784.921568:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+34:25037:x1871643326108800:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938784.921593:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938784.921614:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058b81ed2/0xcd9d312a94a083fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ced expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.921655:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a083f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ce6 expref: 35 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.921664:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.921668:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.921689:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058b81ed2/0xcd9d312a94a083fe lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->147455] (req 0->147455) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ced expref: 35 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.921725:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a083f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ce6 expref: 35 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.921741:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a083f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ce6 expref: 35 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.921798:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342556288:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938784.921895:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff974607ce6180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938784.928196:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.928278:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326108928 00000100:00100000:2.0:1784938784.928293:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326108928 00010000:00010000:2.0:1784938784.928338:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a083f7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ce6 expref: 36 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.928390:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:2.0:1784938784.928400:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603682680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:10026:x1871643326108928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938784.928418:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938784.928464:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a083f7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ce6 expref: 36 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.928482:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a083f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ce6 expref: 36 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.928509:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.928513:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.928523:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058b81ed2/0xcd9d312a94a083fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ced expref: 36 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.928544:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058b81ed2/0xcd9d312a94a083fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ced expref: 36 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.928587:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000058b81ed2/0xcd9d312a94a083fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ced expref: 36 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.928602:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974707fb1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342556416:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938784.928614:0:31425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a083f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ce6 expref: 36 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.928629:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342556288:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938784.928684:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97471da36d80 going to sleep for 11 seconds 00010000:00010000:3.0:1784938784.928844:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058b81ed2/0xcd9d312a94a083fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ced expref: 35 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.928859:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209a400, rc 0) 00000100:00100000:3.0:1784938784.928890:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+35:25037:x1871643326108800:12345-192.168.202.4@tcp:101:cp.0 Request processed in 7323us (8837us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.928898:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:2.0:1784938784.932606:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974707fb1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342556416:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938784.932635:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938784.932699:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603682680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+34:10026:x1871643326108928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4299us (4513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938784.932711:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:0.0:1784938784.935303:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.935483:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326109184 00000100:00100000:3.0:1784938784.935494:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326109184 00000100:00100000:3.0:1784938784.935624:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:3.0:1784938784.935636:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+184:25037:x1871643326109184:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938784.936434:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+185:25037:x1871643326109184:12345-192.168.202.4@tcp:35:cp.0 Request processed in 795us (1145us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1784938784.936444:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:1.0:1784938784.941150:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.941393:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326109312 00000100:00100000:2.0:1784938784.941406:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326109312 00000100:00100000:2.0:1784938784.941493:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 191 00000100:00100000:2.0:1784938784.941503:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+185:25037:x1871643326109312:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.941533:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.941573:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08405 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5cf4 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941645:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a0840c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941661:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a0840c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941672:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a0840c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941687:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a08413 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941694:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a08413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941700:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a08413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941805:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a0840c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941813:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a0840c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941820:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a0840c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941836:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.941840:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a0840c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941848:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a0840c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941861:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.941863:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.941868:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a0840c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941873:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a0840c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941885:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a08413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941890:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a08413 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941895:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a08413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941899:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.941901:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a08413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941918:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a08413 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941937:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x1a616f3f (ffff97473e984500) 00010000:00010000:2.0:1784938784.941940:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.941943:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a08413 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941948:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a08413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.941981:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08405 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cf4 expref: 186 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.942000:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.942002:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.942007:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08405 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cf4 expref: 186 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.942016:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892000, rc 0) 00000100:00100000:2.0:1784938784.942073:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+185:25037:x1871643326109312:12345-192.168.202.4@tcp:101:cp.0 Request processed in 571us (937us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938784.942081:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 191 00000100:00100000:1.0:1784938784.947218:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.947352:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326109440 00000100:00100000:0.0:1784938784.947363:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326109440 00000100:00100000:0.0:1784938784.947415:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 192 00000100:00100000:0.0:1784938784.947439:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+185:25037:x1871643326109440:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.947462:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.947485:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda400/0xcd9d312a94a0841a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5cfb expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947560:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08421 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947575:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947586:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947600:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947607:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947614:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947681:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947689:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08421 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947695:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947711:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddb600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.947716:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947723:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08421 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947735:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.947738:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.947743:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08421 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947776:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08421 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947789:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947795:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08428 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947801:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947806:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938784.947808:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947814:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947832:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x1a616f3f (ffff974609f5d900) 00010000:00010000:0.0:1784938784.947835:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.947838:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08428 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947844:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08428 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947878:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda400/0xcd9d312a94a0841a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cfb expref: 186 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947888:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938784.947890:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938784.947894:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda400/0xcd9d312a94a0841a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cfb expref: 186 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.947903:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602dda400, rc 0) 00000100:00100000:0.0:1784938784.947985:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+185:25037:x1871643326109440:12345-192.168.202.4@tcp:101:cp.0 Request processed in 546us (776us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938784.949076:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 192 00000100:00100000:0.0:1784938784.957302:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.957393:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326109696 00000100:00100000:2.0:1784938784.957403:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326109696 00000100:00100000:2.0:1784938784.957465:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 193 00000100:00100000:2.0:1784938784.957475:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+185:25037:x1871643326109696:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.957498:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.957520:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0842f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d02 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.957689:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08436 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.957703:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08436 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.957715:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08436 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.957729:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a0843d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.957736:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a0843d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.957742:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a0843d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938784.958256:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e:0x0], index 1: 0 00010000:00010000:2.0:1784938784.958422:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08444 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.958433:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.958442:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.958478:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08436 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.958495:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08436 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.958503:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08436 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.958509:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938784.958514:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08436 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.958523:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08436 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.958535:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938784.958539:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938784.958544:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08436 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.958551:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08436 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938784.958564:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d0eca0f6 reply state 000000003e199ea6 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a0843d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938784.958574:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938784.958604:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0842f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d02 expref: 188 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.958618:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d02 expref: 187 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.958636:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff97473e984e00) 00010000:00010000:2.0:1784938784.958639:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938784.958642:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893a00, rc 0) 00000100:00100000:2.0:1784938784.958715:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+188:25037:x1871643326109696:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1241us (1431us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1784938784.958723:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 193 00010000:00010000:1.0:1784938784.962890:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a0843d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.962920:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a0843d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.962928:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a0843d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.962933:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938784.962938:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a0843d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.962945:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a0843d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.962960:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x1a616f3f (ffff97473e984500) 00010000:00010000:1.0:1784938784.962963:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938784.962968:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a0843d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938784.962973:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a0843d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1a616f3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.967052:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938784.967413:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326109824 00000100:00100000:2.0:1784938784.967423:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326109824 00000100:00100000:2.0:1784938784.967474:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 126 00000100:00100000:2.0:1784938784.967484:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:10023:x1871643326109824:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938784.967503:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938784.967525:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08452 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d09 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938784.967566:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938784.967588:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=938s v=(0 0) 00010000:00010000:2.0:1784938784.967594:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938784.967604:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d09 expref: 62 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.967623:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d09 expref: 62 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938784.967637:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893c00, rc 0) 00000100:00100000:2.0:1784938784.967695:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:10023:x1871643326109824:12345-192.168.202.4@tcp:101:cp.0 Request processed in 211us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938784.967716:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 126 00000100:00100000:2.0:1784938784.972854:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938784.972953:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326109952 00000100:00100000:0.0:1784938784.972963:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326109952 00000100:00100000:0.0:1784938784.973028:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 127 00000100:00100000:0.0:1784938784.973038:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:25037:x1871643326109952:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938784.973055:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938784.973086:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3195ec7/0xcd9d312a94a08459 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d10 expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.973119:0:33065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08452 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d09 expref: 63 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.973129:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.973134:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938784.973139:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3195ec7/0xcd9d312a94a08459 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->172031] (req 0->172031) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d10 expref: 63 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.973172:0:33065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d09 expref: 63 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.973187:0:33065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08452 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d09 expref: 63 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.973202:0:33065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342556544:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938784.973673:0:33065:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747104d63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938784.979870:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.979947:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326110080 00000100:00100000:3.0:1784938784.979957:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326110080 00010000:00010000:3.0:1784938784.980007:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08452 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d09 expref: 64 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.980050:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:3.0:1784938784.980062:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+64:10023:x1871643326110080:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938784.980079:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938784.980104:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08452 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d09 expref: 64 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.980120:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08452 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d09 expref: 64 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.980145:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.980150:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938784.980158:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3195ec7/0xcd9d312a94a08459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d10 expref: 64 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.980168:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3195ec7/0xcd9d312a94a08459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d10 expref: 64 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938784.980238:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c3195ec7/0xcd9d312a94a08459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d10 expref: 64 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938784.980262:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342556672:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938784.980343:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470610ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938784.983726:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342556672:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938784.983797:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938784.983847:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+64:10023:x1871643326110080:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3787us (3986us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938784.983859:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 73 00010000:00010000:0.0:1784938784.986516:0:33065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08452 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d09 expref: 63 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938784.986553:0:33065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342556544:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938784.986588:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3195ec7/0xcd9d312a94a08459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d10 expref: 62 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938784.986631:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602dda400, rc 0) 00000100:00100000:0.0:1784938784.986698:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:25037:x1871643326109952:12345-192.168.202.4@tcp:101:cp.0 Request processed in 13661us (13853us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938784.986707:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 127 00000100:00100000:1.0:1784938784.994645:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938784.994797:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326110336 00000100:00100000:3.0:1784938784.994809:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326110336 00000100:00100000:3.0:1784938784.994871:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:3.0:1784938784.994881:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+187:25037:x1871643326110336:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938784.995947:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+188:25037:x1871643326110336:12345-192.168.202.4@tcp:35:cp.0 Request processed in 405us (650us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1784938784.995959:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:1.0:1784938785.001330:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.001475:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326110464 00000100:00100000:3.0:1784938785.001485:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326110464 00000100:00100000:3.0:1784938785.001559:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 194 00000100:00100000:3.0:1784938785.001570:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+188:25037:x1871643326110464:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.001599:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.001622:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08460 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d17 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001719:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08467 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001736:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08467 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001748:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08467 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001805:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a0846e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001815:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a0846e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001822:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a0846e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001888:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08467 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001896:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08467 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001902:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08467 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001920:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938785.001924:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08467 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001942:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08467 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001955:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938785.001958:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938785.001963:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08467 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001969:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08467 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001984:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a0846e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.001990:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a0846e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.002007:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a0846e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.002012:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938785.002014:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a0846e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.002021:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a0846e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.002028:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x6d38f012 (ffff97471a350d00) 00010000:00010000:3.0:1784938785.002031:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938785.002033:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a0846e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.002051:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a0846e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.002088:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08460 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d17 expref: 189 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.002099:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938785.002101:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938785.002105:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08460 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d17 expref: 189 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.002114:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209aa00, rc 0) 00000100:00100000:3.0:1784938785.002168:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+188:25037:x1871643326110464:12345-192.168.202.4@tcp:101:cp.0 Request processed in 600us (848us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938785.002176:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 194 00000100:00100000:1.0:1784938785.006673:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.006929:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326110592 00000100:00100000:2.0:1784938785.006940:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326110592 00000100:00100000:2.0:1784938785.007012:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 195 00000100:00100000:2.0:1784938785.007023:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+188:25037:x1871643326110592:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938785.007043:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938785.007067:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08475 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d1e expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007137:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a0847c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007153:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a0847c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007166:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a0847c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007181:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007188:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007195:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007273:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a0847c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007312:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a0847c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007319:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a0847c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007325:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.007330:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a0847c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007337:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a0847c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007350:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.007353:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.007358:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a0847c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007364:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a0847c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007377:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007383:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08483 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007389:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007394:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.007404:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007411:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08483 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007420:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x6d38f012 (ffff9747029bbd00) 00010000:00010000:2.0:1784938785.007422:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.007425:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08483 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007431:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007468:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08475 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d1e expref: 189 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007479:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.007481:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.007485:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08475 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d1e expref: 189 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.007496:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892800, rc 0) 00000100:00100000:2.0:1784938785.007944:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+188:25037:x1871643326110592:12345-192.168.202.4@tcp:101:cp.0 Request processed in 920us (1281us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938785.007952:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 195 00000100:00100000:1.0:1784938785.014312:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.014448:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326110848 00000100:00100000:3.0:1784938785.014458:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326110848 00000100:00100000:3.0:1784938785.014523:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 196 00000100:00100000:3.0:1784938785.014544:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+188:25037:x1871643326110848:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.014566:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.014589:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0848a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d25 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.014720:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a08491 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.014735:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a08491 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.014795:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a08491 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.014812:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08498 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.014820:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08498 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.014827:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08498 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938785.015373:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f:0x0], index 0: 0 00010000:00010000:3.0:1784938785.015544:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0849f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.015556:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0849f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.015566:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0849f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.015598:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a08491 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.015605:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a08491 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.015613:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a08491 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.015620:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938785.015631:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a08491 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.015640:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a08491 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.015654:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938785.015658:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938785.015663:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a08491 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.015670:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a08491 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938785.015685:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000031243cd reply state 00000000840849a1 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08498 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.015694:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938785.015726:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172200/0xcd9d312a94a0848a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d25 expref: 191 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.015740:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0849f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d25 expref: 190 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.015747:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff97471a350c00) 00010000:00010000:3.0:1784938785.015780:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938785.015783:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172600, rc 0) 00000100:00100000:3.0:1784938785.015867:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+191:25037:x1871643326110848:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1334us (1564us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1784938785.015875:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 196 00000100:00100000:1.0:1784938785.022796:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.022962:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326110976 00000100:00100000:0.0:1784938785.022972:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326110976 00000100:00100000:0.0:1784938785.023046:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 128 00000100:00100000:0.0:1784938785.023057:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+34:10025:x1871643326110976:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.023075:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.023096:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a084ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d2c expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938785.023124:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938785.023165:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=938s v=(0 0) 00010000:00010000:0.0:1784938785.023170:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.023180:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a084ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d2c expref: 35 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.023199:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a084ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d2c expref: 35 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.023215:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddbc00, rc 0) 00000100:00100000:0.0:1784938785.023297:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a666050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+35:10025:x1871643326110976:12345-192.168.202.4@tcp:101:cp.0 Request processed in 241us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.023316:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 128 00000100:00080000:1.0:1784938785.023707:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784938785.024253:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08498 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.024266:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08498 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.024294:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08498 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.024302:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.024306:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08498 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.024315:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08498 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.024331:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x6d38f012 (ffff97471a350d00) 00010000:00010000:2.0:1784938785.024334:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.024339:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08498 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.024346:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08498 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x6d38f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.029718:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.029924:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326111104 00000100:00100000:3.0:1784938785.029934:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326111104 00000100:00100000:3.0:1784938785.030101:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 129 00000100:00100000:3.0:1784938785.030112:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+35:25037:x1871643326111104:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.030131:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.030150:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a084b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d33 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.030182:0:31425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a084ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d2c expref: 36 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.030196:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.030201:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.030207:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a084b4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d33 expref: 36 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.030262:0:31425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a084ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d2c expref: 36 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.030279:0:31425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a084ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d2c expref: 36 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.030301:0:31425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342556800:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938785.030384:0:31425:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470610ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938785.034430:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.034510:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326111232 00000100:00100000:2.0:1784938785.034521:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326111232 00010000:00010000:2.0:1784938785.034576:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a084ad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d2c expref: 37 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.034628:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00100000:2.0:1784938785.034640:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+37:10026:x1871643326111232:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938785.034658:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938785.034686:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a084ad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d2c expref: 37 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.034722:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a084ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d2c expref: 37 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.034798:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.034803:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.034812:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a084b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d33 expref: 37 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.034823:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a084b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d33 expref: 37 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.034864:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a084b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d33 expref: 37 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.034880:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974707fb2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342556928:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938785.034970:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718c0ec00 going to sleep for 11 seconds 00010000:00010000:3.0:1784938785.035389:0:31425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2d0f114/0xcd9d312a94a084ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d2c expref: 37 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.035421:0:31425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31425:1871643342556800:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938785.035447:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a084b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d33 expref: 36 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.035461:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172200, rc 0) 00000100:00100000:3.0:1784938785.035514:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:25037:x1871643326111104:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5404us (5806us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938785.035524:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 129 00000100:00100000:2.0:1784938785.042686:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974707fb2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342556928:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938785.042721:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938785.042822:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+35:10026:x1871643326111232:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8184us (8401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938785.042833:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00100000:0.0:1784938785.056855:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.057395:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326111488 00000100:00100000:2.0:1784938785.057407:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326111488 00000100:00100000:2.0:1784938785.057483:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:2.0:1784938785.057518:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+190:25037:x1871643326111488:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:2.0:1784938785.058234:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+191:25037:x1871643326111488:12345-192.168.202.4@tcp:35:cp.0 Request processed in 716us (1386us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1784938785.058242:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:0.0:1784938785.066015:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.066154:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326111616 00000100:00100000:1.0:1784938785.066176:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326111616 00000100:00100000:1.0:1784938785.066273:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 197 00000100:00100000:1.0:1784938785.066283:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+191:25037:x1871643326111616:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938785.066308:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938785.066329:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a084bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d3a expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066393:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a084c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066408:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a084c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066420:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a084c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066433:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a084c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066441:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a084c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066447:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a084c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066512:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a084c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066520:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a084c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066527:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a084c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066540:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290aa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.066544:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a084c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066552:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a084c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066565:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.066568:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.066573:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a084c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066580:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a084c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066593:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a084c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066599:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a084c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066606:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a084c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066611:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.066614:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a084c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066620:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a084c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066644:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x52815b39 (ffff974702d24500) 00010000:00010000:1.0:1784938785.066648:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.066651:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a084c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066658:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a084c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066694:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a084bb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d3a expref: 192 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066704:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.066706:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.066709:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a084bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d3a expref: 192 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.066718:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290ae00, rc 0) 00000100:00100000:1.0:1784938785.068364:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+191:25037:x1871643326111616:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2071us (2359us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938785.068379:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 197 00010000:00010000:1.0:1784938785.075447:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938785.075748:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.076350:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326111744 00000100:00100000:3.0:1784938785.076362:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326111744 00000100:00100000:3.0:1784938785.076426:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 198 00000100:00100000:3.0:1784938785.076436:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+191:25037:x1871643326111744:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.076459:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.076482:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a084d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d41 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076569:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a084d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076585:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a084d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076598:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a084d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076615:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a084de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076651:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a084de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076659:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a084de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076729:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a084d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076738:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a084d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076744:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a084d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076774:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938785.076779:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a084d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076788:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a084d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076800:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938785.076804:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938785.076809:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a084d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076816:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a084d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076831:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a084de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076845:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a084de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076852:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a084de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076857:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938785.076860:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a084de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076867:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a084de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076876:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x52815b39 (ffff97471a350000) 00010000:00010000:3.0:1784938785.076879:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938785.076882:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a084de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076888:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a084de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076922:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a084d0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d41 expref: 192 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076932:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938785.076934:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938785.076938:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a084d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d41 expref: 192 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.076960:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172c00, rc 0) 00000100:00100000:3.0:1784938785.077247:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+191:25037:x1871643326111744:12345-192.168.202.4@tcp:101:cp.0 Request processed in 810us (1502us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938785.077255:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 198 00000100:00100000:2.0:1784938785.081294:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.081371:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326112000 00000100:00100000:1.0:1784938785.081381:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326112000 00000100:00100000:1.0:1784938785.081444:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 199 00000100:00100000:1.0:1784938785.081455:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+191:25037:x1871643326112000:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938785.081476:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938785.081512:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b400/0xcd9d312a94a084e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d48 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.081689:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a084ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.081706:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a084ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.081717:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a084ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.081732:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a084f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x52815b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.081739:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a084f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.081745:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a084f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938785.082510:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f:0x0], index 1: 0 00010000:00010000:1.0:1784938785.085361:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a084fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.085384:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a084fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.085399:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a084fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.085458:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a084ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.085484:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a084ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.085491:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a084ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.085498:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290bc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.085502:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a084ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.085509:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a084ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.085522:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.085525:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.085605:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a084ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.085613:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a084ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938785.085630:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f69f0266 reply state 00000000d164fdc3 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a084f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938785.085649:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938785.085694:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b400/0xcd9d312a94a084e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d48 expref: 194 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.085710:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a084fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d48 expref: 193 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.085729:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff974702d24500) 00010000:00010000:1.0:1784938785.085732:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938785.085734:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290ae00, rc 0) 00000100:00100000:1.0:1784938785.086969:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+194:25037:x1871643326112000:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5506us (5677us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1784938785.086981:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 199 00010000:00010000:1.0:1784938785.092787:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a084f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.092806:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a084f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.092815:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a084f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.092821:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.092826:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a084f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.092835:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a084f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.092852:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x52815b39 (ffff974702d24200) 00010000:00010000:1.0:1784938785.092855:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.092860:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a084f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.092868:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a084f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x52815b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.102011:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.102119:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326112128 00000100:00100000:0.0:1784938785.102139:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326112128 00000100:00100000:0.0:1784938785.102255:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 130 00000100:00100000:0.0:1784938785.102271:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:10024:x1871643326112128:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.102290:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.102313:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfb5677e/0xcd9d312a94a08508 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d4f expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938785.102343:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938785.102365:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=938s v=(0 0) 00010000:00010000:0.0:1784938785.102370:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.102380:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfb5677e/0xcd9d312a94a08508 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d4f expref: 63 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.102397:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dfb5677e/0xcd9d312a94a08508 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d4f expref: 63 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.102410:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602dda200, rc 0) 00000100:00100000:0.0:1784938785.102480:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:10024:x1871643326112128:12345-192.168.202.4@tcp:101:cp.0 Request processed in 216us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.102487:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 130 00000100:00080000:1.0:1784938785.102576:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938785.109710:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.111860:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326112256 00000100:00100000:0.0:1784938785.111913:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326112256 00000100:00100000:0.0:1784938785.112011:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 131 00000100:00100000:0.0:1784938785.112025:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974707fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:25037:x1871643326112256:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.112054:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.112084:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d16a20e0/0xcd9d312a94a0850f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d56 expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.112129:0:33065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfb5677e/0xcd9d312a94a08508 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d4f expref: 64 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.112140:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.112146:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.112152:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d16a20e0/0xcd9d312a94a0850f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d56 expref: 64 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.112200:0:33065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfb5677e/0xcd9d312a94a08508 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d4f expref: 64 pid: 31427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.112244:0:33065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfb5677e/0xcd9d312a94a08508 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d4f expref: 64 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938785.112261:0:33065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342557056:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938785.112410:0:33065:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747104d63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938785.122183:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.122456:0:33065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:33065:1871643342557056:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938785.122506:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d16a20e0/0xcd9d312a94a0850f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->217087] (req 0->217087) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d56 expref: 64 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.122564:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddb000, rc 0) 00000100:00100000:3.0:1784938785.122679:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326112384 00000100:00100000:3.0:1784938785.122696:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326112384 00010000:00010000:3.0:1784938785.122849:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfb5677e/0xcd9d312a94a08508 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d4f expref: 65 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.123023:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:3.0:1784938785.123035:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+65:10023:x1871643326112384:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938785.123054:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938785.123085:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfb5677e/0xcd9d312a94a08508 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d4f expref: 65 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938785.123088:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974707fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+65:25037:x1871643326112256:12345-192.168.202.4@tcp:101:cp.0 Request processed in 11061us (13390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.123114:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 131 00010000:00010000:3.0:1784938785.123125:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfb5677e/0xcd9d312a94a08508 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d4f expref: 65 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.123160:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfb5677e/0xcd9d312a94a08508 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d4f expref: 64 pid: 31427 timeout: 1038 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.123180:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.123186:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.123196:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d16a20e0/0xcd9d312a94a0850f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d56 expref: 63 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.123240:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d16a20e0/0xcd9d312a94a0850f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d56 expref: 63 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.123279:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d16a20e0/0xcd9d312a94a0850f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d56 expref: 63 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.123292:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342557184:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938785.123366:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470610ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938785.139487:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342557312:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938785.140022:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938785.140057:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342557312 00000100:00100000:1.0:1784938785.140067:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342557312 00000100:00100000:1.0:1784938785.140150:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 16 00000100:00100000:1.0:1784938785.140162:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:12803:x1871643342557312:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938785.140195:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 11927552 granted 91815936 pending 23855104 free 390070272 avail 387973120 00000100:00100000:1.0:1784938785.140268:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:12803:x1871643342557312:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 107us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938785.140276:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 16 00000100:00080000:1.0:1784938785.141122:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938785.141474:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342557568:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938785.141476:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342557440:0@lo:400:kworker.0 00000100:00100000:0.0:1784938785.142940:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938785.143015:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:12804:1871643342557952:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938785.143129:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342557440 00000100:00100000:0.0:1784938785.143139:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342557440 00000100:00100000:0.0:1784938785.143198:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784938785.143209:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12804:x1871643342557440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938785.143287:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12804:x1871643342557440:12345-0@lo:400:kworker.0 Request processed in 79us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.143295:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784938785.143345:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342557696:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938785.143382:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938785.143390:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974735403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342557824:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938785.143454:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342557440:0@lo:400:kworker.0 00000100:00100000:0.0:1784938785.147699:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342557184:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938785.147734:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938785.147806:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:10023:x1871643326112384:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 24772us (25637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.147836:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:2.0:1784938785.147931:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.148235:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326112640 00000100:00100000:0.0:1784938785.148268:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326112640 00000100:00100000:0.0:1784938785.148340:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:1.0:1784938785.148349:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938785.148357:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+193:25037:x1871643326112640:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:1.0:1784938785.148384:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938785.148412:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342557696 00000100:00100000:1.0:1784938785.148420:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342557696 00000100:00080000:1.0:1784938785.148449:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938785.148492:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342557568 00000100:00100000:1.0:1784938785.148496:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342557568 00000100:00100000:1.0:1784938785.148543:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 27 00000100:00100000:1.0:1784938785.148552:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342557696:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938785.148627:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342557696:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 76us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938785.148634:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 27 00000100:00100000:1.0:1784938785.148652:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 28 00000100:00100000:1.0:1784938785.148659:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342557568:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938785.148705:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342557568:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 46us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938785.148712:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 28 00000100:00100000:2.0:1784938785.149472:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938785.149701:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938785.149828:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342557696:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938785.150165:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342557952 00000100:00100000:1.0:1784938785.150173:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342557952 00000100:00100000:1.0:1784938785.150298:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 29 00000100:00100000:1.0:1784938785.150310:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12804:x1871643342557952:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938785.150382:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12804:x1871643342557952:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 71us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938785.150391:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 29 00000100:00100000:3.0:1784938785.150411:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342557568:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938785.150621:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:12804:1871643342557952:192.168.202.104@tcp:400:kworker.0 00000100:00080000:2.0:1784938785.152982:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938785.157006:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342557312:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938785.157932:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342557824 00000100:00100000:0.0:1784938785.157945:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342557824 00000100:00080000:2.0:1784938785.158021:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938785.161292:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 13 00000100:00100000:0.0:1784938785.161311:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:12802:x1871643342557824:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938785.161407:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:12802:x1871643342557824:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 103us (11706us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.161415:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 13 00000100:00100000:0.0:1784938785.165466:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+194:25037:x1871643326112640:12345-192.168.202.4@tcp:35:cp.0 Request processed in 17097us (17526us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1784938785.165484:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:0.0:1784938785.166385:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974735403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342557824:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938785.188413:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.188465:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326112768 00000100:00100000:2.0:1784938785.188479:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326112768 00000100:00100000:2.0:1784938785.188551:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 200 00000100:00100000:2.0:1784938785.188564:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+194:25037:x1871643326112768:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938785.188598:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938785.188630:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892400/0xcd9d312a94a08516 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d5d expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.188770:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0851d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.188790:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0851d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191188:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0851d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191243:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191257:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191264:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191353:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0851d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191362:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0851d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191369:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0851d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191375:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.191380:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0851d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191408:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0851d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191423:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.191427:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.191433:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0851d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191440:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0851d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191456:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191462:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08524 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191468:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191473:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.191476:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191482:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08524 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191489:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9cfce7b5 (ffff9747029bbd00) 00010000:00010000:2.0:1784938785.191491:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.191494:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08524 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191509:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191565:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892400/0xcd9d312a94a08516 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d5d expref: 195 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191576:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.191578:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.191582:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892400/0xcd9d312a94a08516 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d5d expref: 195 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.191592:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892400, rc 0) 00000100:00100000:2.0:1784938785.191705:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+194:25037:x1871643326112768:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3142us (3308us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938785.191716:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 200 00000100:00100000:2.0:1784938785.206046:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.206190:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326112896 00000100:00100000:3.0:1784938785.206204:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326112896 00000100:00100000:3.0:1784938785.206286:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 201 00000100:00100000:3.0:1784938785.206298:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+194:25037:x1871643326112896:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.206329:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.206359:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a0852b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d64 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206457:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08532 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206475:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08532 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206490:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08532 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206526:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08539 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206535:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206543:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206629:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08532 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206638:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08532 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206646:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08532 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206653:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938785.206658:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08532 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206668:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08532 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206683:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938785.206686:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938785.206691:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08532 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206698:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a08532 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.206730:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.207293:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08539 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.207300:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.207306:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938785.207310:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.207317:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08539 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.207328:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9cfce7b5 (ffff97471a350000) 00010000:00010000:3.0:1784938785.207331:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938785.207333:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08539 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.207339:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08539 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.207392:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a0852b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d64 expref: 195 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.207404:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938785.207406:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938785.207420:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a0852b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d64 expref: 195 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.207432:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172c00, rc 0) 00000100:00100000:3.0:1784938785.207518:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+194:25037:x1871643326112896:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1221us (1497us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938785.207527:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 201 00000100:00100000:1.0:1784938785.216232:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.216390:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326113152 00000100:00100000:3.0:1784938785.216403:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326113152 00000100:00100000:3.0:1784938785.216482:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 202 00000100:00100000:3.0:1784938785.216495:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+194:25037:x1871643326113152:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.216523:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.216552:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a08540 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d6b expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.216715:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08547 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.216733:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08547 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.216747:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08547 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.216794:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0854e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.216803:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0854e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.216810:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0854e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938785.220381:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20:0x0], index 0: 0 00010000:00010000:3.0:1784938785.220650:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08555 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.220671:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.220686:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.220784:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08547 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.220793:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08547 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.220800:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08547 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.220806:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938785.220812:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08547 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.220820:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08547 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.220836:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938785.220839:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938785.220845:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08547 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.220867:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172800/0xcd9d312a94a08547 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938785.220885:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a66138f reply state 000000007e8721a9 transno 4294967422 ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0854e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.220896:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938785.220946:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a08540 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d6b expref: 197 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.220964:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d6b expref: 196 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.220972:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff97471a350e00) 00010000:00010000:3.0:1784938785.220974:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938785.220977:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209aa00, rc 0) 00000100:00100000:3.0:1784938785.221074:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+197:25037:x1871643326113152:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4581us (4863us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1784938785.221085:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 202 00010000:00010000:0.0:1784938785.227188:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0854e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.227207:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0854e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.227226:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0854e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.227234:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938785.227260:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0854e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.227270:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0854e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.227292:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9cfce7b5 (ffff97471a350000) 00010000:00010000:0.0:1784938785.227296:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938785.227302:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0854e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.227309:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a0854e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9cfce7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938785.240304:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.240692:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326113280 00000100:00100000:3.0:1784938785.240710:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326113280 00000100:00100000:3.0:1784938785.240846:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 132 00000100:00100000:3.0:1784938785.240859:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+35:10026:x1871643326113280:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.240886:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.240919:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a08563 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d72 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938785.240986:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938785.241013:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=939s v=(0 0) 00010000:00010000:3.0:1784938785.241019:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.241032:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a08563 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d72 expref: 36 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.241058:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a08563 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d72 expref: 36 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.241076:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172c00, rc 0) 00000100:00100000:3.0:1784938785.241171:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:10026:x1871643326113280:12345-192.168.202.4@tcp:101:cp.0 Request processed in 314us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938785.241181:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 132 00000100:00100000:3.0:1784938785.257070:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.257846:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326113408 00000100:00100000:3.0:1784938785.257861:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326113408 00000100:00100000:3.0:1784938785.257940:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 133 00000100:00100000:3.0:1784938785.257954:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:25037:x1871643326113408:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.257983:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.258009:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039cbf935/0xcd9d312a94a0856a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d79 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.258049:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a08563 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d72 expref: 37 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.258086:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.258092:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.258098:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039cbf935/0xcd9d312a94a0856a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->200703] (req 0->200703) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d79 expref: 37 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.258179:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a08563 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d72 expref: 37 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.258197:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a08563 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d72 expref: 37 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.258215:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342558080:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938785.258363:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474005b300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938785.264097:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342558080:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938785.264164:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000039cbf935/0xcd9d312a94a0856a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->200703] (req 0->200703) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d79 expref: 37 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.264195:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742172800, rc 0) 00000100:00100000:0.0:1784938785.264284:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+37:25037:x1871643326113408:12345-192.168.202.4@tcp:101:cp.0 Request processed in 6329us (7231us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.264294:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 133 00000100:00100000:1.0:1784938785.271893:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.272272:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326113536 00000100:00100000:2.0:1784938785.272634:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326113536 00010000:00010000:2.0:1784938785.272695:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a08563 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d72 expref: 37 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.272787:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:2.0:1784938785.272802:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+37:10026:x1871643326113536:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938785.272821:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938785.272852:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a08563 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d72 expref: 37 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.272886:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a08563 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d72 expref: 37 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.272917:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd52ebab/0xcd9d312a94a08563 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d72 expref: 37 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.272940:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.272945:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.272957:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000039cbf935/0xcd9d312a94a0856a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d79 expref: 36 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.272971:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039cbf935/0xcd9d312a94a0856a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d79 expref: 36 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.273021:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000039cbf935/0xcd9d312a94a0856a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d79 expref: 36 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.273114:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974609ea3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342558208:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938785.273362:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938785.276844:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974609ea3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342558208:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938785.276882:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938785.276960:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:10026:x1871643326113536:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4160us (5080us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938785.276975:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 76 00000001:00080000:3.0:1784938785.277208:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1784938785.277254:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1784938785.277269:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1784938785.297917:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.297970:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.298009:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.301703:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.301798:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.302389:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326113664 00000100:00100000:0.0:1784938785.302404:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326113664 00002000:00100000:0.0:1784938785.302482:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x10:0x0] (0->268) req@ffff9746047bd180 x1871643326113664/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 760/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938785.302495:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bd180 with x1871643326113664 ext(0->268) 00002000:00010000:0.0:1784938785.302502:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9746047bd180 00000100:00100000:0.0:1784938785.302548:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326113792 00000100:00100000:0.0:1784938785.302553:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326113792 00002000:00100000:0.0:1784938785.302571:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (0->4116) req@ffff9746047bf100 x1871643326113792/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 4608/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938785.302580:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bf100 with x1871643326113792 ext(0->4116) 00002000:00010000:0.0:1784938785.302585:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9746047bf100 00000100:00100000:0.0:1784938785.302593:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326114432 00000100:00100000:0.0:1784938785.302596:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326114432 00002000:00100000:0.0:1784938785.302614:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x16:0x0] (0->35426) req@ffff9746047bfb80 x1871643326114432/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 488/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938785.302622:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bfb80 with x1871643326114432 ext(0->35426) 00002000:00010000:0.0:1784938785.302627:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9746047bfb80 00000100:00100000:0.0:1784938785.302635:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326114304 00000100:00100000:0.0:1784938785.302638:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326114304 00002000:00100000:0.0:1784938785.302651:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x15:0x0] (0->6233) req@ffff97472a1e6d80 x1871643326114304/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 6728/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938785.302659:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1e6d80 with x1871643326114304 ext(0->6233) 00002000:00010000:0.0:1784938785.302663:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97472a1e6d80 00000100:00100000:0.0:1784938785.302669:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326113920 00000100:00100000:0.0:1784938785.302672:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326113920 00002000:00100000:0.0:1784938785.302684:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x12:0x0] (0->4149) req@ffff97472a1e6680 x1871643326113920/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 4640/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938785.302692:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1e6680 with x1871643326113920 ext(0->4149) 00002000:00010000:0.0:1784938785.302695:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97472a1e6680 00000100:00100000:0.0:1784938785.302708:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:0.0:1784938785.302717:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+40:10023:x1871643326113664:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938785.302855:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:3.0:1784938785.302865:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+40:10024:x1871643326113792:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938785.312341:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.312424:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.312695:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.312816:0:33062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1784938785.312829:0:33062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1784938785.312856:0:31431:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1784938785.312865:0:31431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326114048 00000100:00100000:2.0:1784938785.312876:0:31431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326114048 00002000:00100000:2.0:1784938785.313536:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x13:0x0] (0->8440) req@ffff974601c23b80 x1871643326114048/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 8936/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784938785.313549:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+43:10023:x1871643326113664:12345-192.168.202.4@tcp:4:cp.0 Request processed in 10826us (15643us total) trans 4294967320 rc 0/0 00002000:00100000:2.0:1784938785.313552:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601c23b80 with x1871643326114048 ext(0->8440) 00002000:00010000:2.0:1784938785.313564:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974601c23b80 00000100:00100000:0.0:1784938785.313570:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00002000:00100000:0.0:1784938785.313581:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x10:0x0] (0->268) req@ffff9746047bd180 x1871643326113664/t4294967320(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 760/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784938785.313589:0:31431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326114560 00002000:00100000:0.0:1784938785.313592:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bd180 with x1871643326113664 ext(0->268) 00000100:00100000:2.0:1784938785.313595:0:31431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326114560 00002000:00010000:0.0:1784938785.313599:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9746047bd180 00002000:00100000:2.0:1784938785.313616:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x17:0x0] (0->2128) req@ffff974601c21880 x1871643326114560/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 2624/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938785.313626:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601c21880 with x1871643326114560 ext(0->2128) 00000100:00100000:0.0:1784938785.313629:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326114688 00002000:00010000:2.0:1784938785.313631:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974601c21880 00000100:00100000:0.0:1784938785.313635:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326114688 00000100:00100000:2.0:1784938785.313651:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00002000:00100000:0.0:1784938785.313660:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x18:0x0] (0->37841) req@ffff974601c21180 x1871643326114688/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 488/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784938785.313666:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+44:10025:x1871643326114432:12345-192.168.202.4@tcp:4:cp.0 00002000:00100000:0.0:1784938785.313678:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601c21180 with x1871643326114688 ext(0->37841) 00002000:00010000:0.0:1784938785.313684:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974601c21180 00000100:00100000:3.0:1784938785.316697:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+47:10024:x1871643326113792:12345-192.168.202.4@tcp:4:cp.0 Request processed in 13812us (18705us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1784938785.316726:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00002000:00100000:3.0:1784938785.316748:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (0->4116) req@ffff9746047bf100 x1871643326113792/t4294967321(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 4608/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938785.317046:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bf100 with x1871643326113792 ext(0->4116) 00002000:00010000:3.0:1784938785.317056:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9746047bf100 00000100:00100000:1.0:1784938785.317768:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.317816:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326114176 00000100:00100000:1.0:1784938785.317829:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326114176 00002000:00100000:1.0:1784938785.317904:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x14:0x0] (0->1693) req@ffff974601c20a80 x1871643326114176/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 2184/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938785.317915:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601c20a80 with x1871643326114176 ext(0->1693) 00002000:00010000:1.0:1784938785.317920:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974601c20a80 00000100:00100000:3.0:1784938785.320700:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:3.0:1784938785.320740:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+47:10024:x1871643326114304:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938785.322859:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+49:10024:x1871643326114304:12345-192.168.202.4@tcp:4:cp.0 Request processed in 2125us (21154us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1784938785.322876:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 31 00002000:00100000:3.0:1784938785.322891:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x15:0x0] (0->6233) req@ffff97472a1e6d80 x1871643326114304/t4294967322(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 6728/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938785.322903:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1e6d80 with x1871643326114304 ext(0->6233) 00002000:00010000:3.0:1784938785.322912:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97472a1e6d80 00000100:00100000:3.0:1784938785.322949:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:3.0:1784938785.322967:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+48:10025:x1871643326113920:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938785.323453:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+50:10025:x1871643326113920:12345-192.168.202.4@tcp:4:cp.0 Request processed in 492us (21653us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1784938785.323462:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00002000:00100000:3.0:1784938785.323470:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x12:0x0] (0->4149) req@ffff97472a1e6680 x1871643326113920/t4294967323(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 4640/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938785.323480:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1e6680 with x1871643326113920 ext(0->4149) 00002000:00010000:3.0:1784938785.323492:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97472a1e6680 00000100:00100000:3.0:1784938785.323515:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:3.0:1784938785.323523:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+49:10026:x1871643326114048:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938785.323816:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:10026:x1871643326114048:12345-192.168.202.4@tcp:4:cp.0 Request processed in 294us (11492us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1784938785.323824:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00002000:00100000:3.0:1784938785.323830:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x13:0x0] (0->8440) req@ffff974601c23b80 x1871643326114048/t4294967324(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 8936/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938785.323839:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601c23b80 with x1871643326114048 ext(0->8440) 00002000:00010000:3.0:1784938785.323843:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974601c23b80 00000100:00100000:3.0:1784938785.323860:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:3.0:1784938785.323868:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+50:10026:x1871643326114560:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938785.324068:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+52:10026:x1871643326114560:12345-192.168.202.4@tcp:4:cp.0 Request processed in 199us (11643us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1784938785.324075:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00002000:00100000:3.0:1784938785.324081:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x17:0x0] (0->2128) req@ffff974601c21880 x1871643326114560/t4294967325(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 2624/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938785.324090:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601c21880 with x1871643326114560 ext(0->2128) 00002000:00010000:3.0:1784938785.324095:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974601c21880 00000100:00100000:3.0:1784938785.324107:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:3.0:1784938785.324115:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:10023:x1871643326114688:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938785.327496:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:1.0:1784938785.327531:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+52:10023:x1871643326114176:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938785.328269:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:10023:x1871643326114176:12345-192.168.202.4@tcp:4:cp.0 Request processed in 742us (10529us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1784938785.328416:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 00002000:00100000:1.0:1784938785.328434:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x14:0x0] (0->1693) req@ffff974601c20a80 x1871643326114176/t4294967326(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 2184/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938785.328446:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601c20a80 with x1871643326114176 ext(0->1693) 00002000:00010000:1.0:1784938785.328455:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974601c20a80 00000100:00100000:2.0:1784938785.332488:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.332865:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326114944 00000100:00100000:0.0:1784938785.332878:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326114944 00000100:00100000:0.0:1784938785.332966:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:0.0:1784938785.332979:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+196:25037:x1871643326114944:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938785.333521:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+197:25037:x1871643326114944:12345-192.168.202.4@tcp:35:cp.0 Request processed in 542us (1046us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1784938785.333532:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:2.0:1784938785.335127:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:10025:x1871643326114432:12345-192.168.202.4@tcp:4:cp.0 Request processed in 21442us (37093us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1784938785.335143:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00002000:00100000:2.0:1784938785.335170:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (0->35426) req@ffff9746047bfb80 x1871643326114432/t4294967327(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 488/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938785.335182:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bfb80 with x1871643326114432 ext(0->35426) 00002000:00010000:2.0:1784938785.335191:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9746047bfb80 00000100:00100000:0.0:1784938785.338024:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:10023:x1871643326114688:12345-192.168.202.4@tcp:4:cp.0 Request processed in 13887us (25306us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1784938785.338043:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00002000:00100000:0.0:1784938785.338060:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x18:0x0] (0->37841) req@ffff974601c21180 x1871643326114688/t4294967328(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 488/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938785.338102:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601c21180 with x1871643326114688 ext(0->37841) 00002000:00010000:0.0:1784938785.338110:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974601c21180 00000100:00100000:3.0:1784938785.352015:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.353072:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326115072 00000100:00100000:1.0:1784938785.353102:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326115072 00000100:00100000:1.0:1784938785.353213:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 203 00000100:00100000:1.0:1784938785.353236:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+197:25037:x1871643326115072:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938785.353275:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938785.353306:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a08571 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d80 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353397:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08578 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353416:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08578 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353429:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08578 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353448:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a0857f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353480:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a0857f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353487:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a0857f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353574:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08578 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353583:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08578 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353590:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353598:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.353603:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353679:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08578 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353695:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.353699:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.353705:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08578 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353711:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08578 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353726:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a0857f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353739:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a0857f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353744:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a0857f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353818:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290aa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.353822:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a0857f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353830:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a0857f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353839:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe708c894 (ffff974702d24900) 00010000:00010000:1.0:1784938785.353842:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.353845:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a0857f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353851:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a0857f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353908:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a08571 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d80 expref: 198 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353920:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.353922:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.353926:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a08571 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d80 expref: 198 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.353948:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290b000, rc 0) 00000100:00100000:1.0:1784938785.354044:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+197:25037:x1871643326115072:12345-192.168.202.4@tcp:101:cp.0 Request processed in 809us (2038us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938785.354052:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 203 00000100:00100000:1.0:1784938785.369607:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.369734:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326115200 00000100:00100000:2.0:1784938785.369825:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326115200 00000100:00100000:2.0:1784938785.369914:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 204 00000100:00100000:2.0:1784938785.369926:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+197:25037:x1871643326115200:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938785.369956:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938785.369990:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a08586 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d87 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.370082:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0858d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.370729:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0858d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.370850:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0858d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.370874:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08594 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.370883:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.370888:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.370978:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0858d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.370985:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0858d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.370992:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0858d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.371013:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.371018:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0858d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.371026:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0858d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.371040:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.371043:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.371048:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0858d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.371054:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a0858d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.371069:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.371075:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08594 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.371081:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08594 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.371086:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.371088:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08594 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.371093:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08594 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.372563:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe708c894 (ffff9747029bb600) 00010000:00010000:2.0:1784938785.372567:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.372573:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08594 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.372581:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893400/0xcd9d312a94a08594 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.372672:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a08586 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d87 expref: 198 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.372686:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.372688:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.372693:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a08586 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d87 expref: 198 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.372704:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893800, rc 0) 00000100:00100000:2.0:1784938785.372828:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+197:25037:x1871643326115200:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2903us (3230us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938785.372839:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 204 00000100:00100000:2.0:1784938785.376142:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.376234:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326115456 00000100:00100000:3.0:1784938785.376269:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326115456 00000100:00100000:3.0:1784938785.376371:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 205 00000100:00100000:3.0:1784938785.376382:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+197:25037:x1871643326115456:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.376406:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.376429:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a0859b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d8e expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.376581:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a085a2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.376595:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a085a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.376608:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a085a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.376621:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a085a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xe708c894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.376629:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a085a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.376634:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a085a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938785.377443:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20:0x0], index 1: 0 00010000:00010000:3.0:1784938785.377606:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045600/0xcd9d312a94a085b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.377617:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045600/0xcd9d312a94a085b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.377639:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045600/0xcd9d312a94a085b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.377676:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a085a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.377684:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a085a2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.377691:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a085a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.377697:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938785.377701:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a085a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.377708:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a085a2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.377720:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938785.377723:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938785.377729:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a085a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.377735:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172c00/0xcd9d312a94a085a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938785.379441:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ecb259b8 reply state 00000000e3dbd405 transno 4294967424 ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a085a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.379462:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938785.379535:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a0859b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d8e expref: 200 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.379560:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045600/0xcd9d312a94a085b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d8e expref: 199 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.379570:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff97471a350900) 00010000:00010000:3.0:1784938785.379573:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938785.379576:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045600, rc 0) 00000100:00100000:3.0:1784938785.379703:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+200:25037:x1871643326115456:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3321us (3576us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1784938785.379713:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 205 00010000:00010000:2.0:1784938785.388878:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a085a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.388897:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a085a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.388906:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a085a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.388929:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742172a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.388935:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a085a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.388943:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a085a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.388962:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe708c894 (ffff97471a350b00) 00010000:00010000:2.0:1784938785.388965:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.388970:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a085a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.388977:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172a00/0xcd9d312a94a085a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe708c894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.396721:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.397014:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326115584 00000100:00100000:3.0:1784938785.397026:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326115584 00000100:00100000:3.0:1784938785.397078:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 134 00000100:00100000:3.0:1784938785.397089:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+35:10023:x1871643326115584:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.397109:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.397133:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a085be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d95 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938785.397164:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938785.397187:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=939s v=(0 0) 00010000:00010000:3.0:1784938785.397192:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.397202:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a085be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d95 expref: 36 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.397260:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a085be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d95 expref: 36 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.397306:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045a00, rc 0) 00000100:00100000:3.0:1784938785.397384:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:10023:x1871643326115584:12345-192.168.202.4@tcp:101:cp.0 Request processed in 295us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938785.397392:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 134 00000100:00100000:3.0:1784938785.406848:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.406946:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326115712 00000100:00100000:0.0:1784938785.406964:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326115712 00000100:00100000:0.0:1784938785.407063:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 135 00000100:00100000:0.0:1784938785.407077:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:25037:x1871643326115712:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.407115:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.407146:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5f095b6/0xcd9d312a94a085c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5d9c expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.407192:0:31428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a085be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d95 expref: 37 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.407203:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.407208:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.407227:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5f095b6/0xcd9d312a94a085c5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d9c expref: 37 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.407273:0:31428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a085be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d95 expref: 37 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.407291:0:31428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a085be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d95 expref: 37 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938785.407309:0:31428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342558336:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938785.407463:0:31428:0:(client.c:2702:ptlrpc_set_wait()) set ffff974713587d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938785.416704:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.417549:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326115840 00000100:00100000:3.0:1784938785.417561:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326115840 00010000:00010000:3.0:1784938785.417609:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a085be lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d95 expref: 38 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.417660:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:3.0:1784938785.417671:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+38:10026:x1871643326115840:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938785.417688:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938785.417715:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a085be lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d95 expref: 38 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.417730:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a085be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d95 expref: 38 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.417901:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.417906:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.417917:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5f095b6/0xcd9d312a94a085c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d9c expref: 38 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.417953:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5f095b6/0xcd9d312a94a085c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d9c expref: 38 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.418053:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a5f095b6/0xcd9d312a94a085c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d9c expref: 38 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.418068:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602691180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342558464:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938785.418152:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca180 going to sleep for 11 seconds 00010000:00010000:0.0:1784938785.418415:0:31428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a085be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d95 expref: 38 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938785.418431:0:31428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342558336:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938785.418458:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a5f095b6/0xcd9d312a94a085c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d9c expref: 37 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.418469:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddb200, rc 0) 00000100:00100000:0.0:1784938785.418500:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+37:25037:x1871643326115712:12345-192.168.202.4@tcp:101:cp.0 Request processed in 11427us (11661us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.418507:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 135 00000100:00100000:0.0:1784938785.433817:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602691180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342558464:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938785.433844:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938785.433898:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:10026:x1871643326115840:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 16228us (17204us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.433909:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:1.0:1784938785.436173:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.436514:0:33067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326115968 00000100:00100000:0.0:1784938785.436526:0:33067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326115968 00002000:00100000:0.0:1784938785.436582:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x10:0x0] (0->233) req@ffff974601c23480 x1871643326115968/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 728/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938785.436594:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601c23480 with x1871643326115968 ext(0->233) 00002000:00010000:0.0:1784938785.436601:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974601c23480 00000100:00100000:0.0:1784938785.436641:0:33067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:0.0:1784938785.436651:0:33067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+36:10025:x1871643326115968:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938785.437416:0:33067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+38:10025:x1871643326115968:12345-192.168.202.4@tcp:4:cp.0 Request processed in 763us (1252us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1784938785.437425:0:33067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00002000:00100000:0.0:1784938785.437433:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x10:0x0] (0->233) req@ffff974601c23480 x1871643326115968/t4294967320(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 728/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938785.437441:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601c23480 with x1871643326115968 ext(0->233) 00002000:00010000:0.0:1784938785.437446:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974601c23480 00000100:00100000:2.0:1784938785.442718:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.442766:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.442810:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.445461:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.460644:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.463737:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326116352 00000100:00100000:1.0:1784938785.465422:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326116352 00000100:00100000:1.0:1784938785.465462:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326116224 00000100:00100000:1.0:1784938785.465468:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326116224 00002000:00100000:1.0:1784938785.465722:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x12:0x0] (0->7184) req@ffff974602691f80 x1871643326116224/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 7680/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938785.465734:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974602691f80 with x1871643326116224 ext(0->7184) 00002000:00010000:1.0:1784938785.465741:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974602691f80 00000100:00100000:1.0:1784938785.465854:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326116096 00000100:00100000:1.0:1784938785.465858:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326116096 00002000:00100000:1.0:1784938785.465875:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x11:0x0] (0->3078) req@ffff974602690700 x1871643326116096/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 3568/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938785.465884:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974602690700 with x1871643326116096 ext(0->3078) 00002000:00010000:1.0:1784938785.465888:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974602690700 00000100:00100000:1.0:1784938785.465896:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326116736 00000100:00100000:1.0:1784938785.465898:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326116736 00002000:00100000:1.0:1784938785.465910:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x16:0x0] (0->13878) req@ffff97472a1e7b80 x1871643326116736/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 14368/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938785.465942:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1e7b80 with x1871643326116736 ext(0->13878) 00002000:00010000:1.0:1784938785.465947:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97472a1e7b80 00000100:00100000:1.0:1784938785.465961:0:33062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:1.0:1784938785.465970:0:33062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+41:10024:x1871643326116224:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938785.466366:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:0.0:1784938785.466377:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+41:10024:x1871643326116096:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938785.466670:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+43:10024:x1871643326116096:12345-192.168.202.4@tcp:4:cp.0 Request processed in 294us (23869us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1784938785.466678:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 39 00002000:00100000:0.0:1784938785.466685:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x11:0x0] (0->3078) req@ffff974602690700 x1871643326116096/t4294967321(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 3568/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938785.466693:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974602690700 with x1871643326116096 ext(0->3078) 00002000:00010000:0.0:1784938785.466697:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974602690700 00000100:00100000:0.0:1784938785.466717:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:0.0:1784938785.466725:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+42:10023:x1871643326116736:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938785.468046:0:33062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+46:10024:x1871643326116224:12345-192.168.202.4@tcp:4:cp.0 Request processed in 2069us (25284us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1784938785.468056:0:33062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 38 00002000:00100000:1.0:1784938785.468066:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x12:0x0] (0->7184) req@ffff974602691f80 x1871643326116224/t4294967323(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 7680/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938785.468075:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974602691f80 with x1871643326116224 ext(0->7184) 00002000:00010000:1.0:1784938785.468080:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974602691f80 00000100:00100000:1.0:1784938785.468100:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326116480 00000100:00100000:1.0:1784938785.468106:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326116480 00002000:00100000:1.0:1784938785.468132:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x14:0x0] (0->6429) req@ffff97473a636d80 x1871643326116480/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 6920/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938785.468139:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473a636d80 with x1871643326116480 ext(0->6429) 00002000:00010000:1.0:1784938785.468142:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473a636d80 00000100:00100000:1.0:1784938785.468156:0:33062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:1.0:1784938785.468163:0:33062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+46:10026:x1871643326116480:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938785.468910:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+46:10023:x1871643326116736:12345-192.168.202.4@tcp:4:cp.0 Request processed in 2181us (23454us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1784938785.468918:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 40 00002000:00100000:0.0:1784938785.468926:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x16:0x0] (0->13878) req@ffff97472a1e7b80 x1871643326116736/t4294967322(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 14368/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938785.468947:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97472a1e7b80 with x1871643326116736 ext(0->13878) 00002000:00010000:0.0:1784938785.468951:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97472a1e7b80 00002000:00100000:0.0:1784938785.469110:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (0->1789) req@ffff974602690380 x1871643326116352/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 2280/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938785.469118:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974602690380 with x1871643326116352 ext(0->1789) 00002000:00010000:0.0:1784938785.469121:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974602690380 00000100:00100000:0.0:1784938785.469143:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:0.0:1784938785.469149:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+45:10025:x1871643326116352:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938785.469553:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.469587:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.469601:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.469619:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.469644:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326117248 00000100:00100000:0.0:1784938785.469650:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326117248 00000100:00100000:0.0:1784938785.469688:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:0.0:1784938785.469695:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+199:25037:x1871643326117248:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:1.0:1784938785.471042:0:33062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+47:10026:x1871643326116480:12345-192.168.202.4@tcp:4:cp.0 Request processed in 2868us (10396us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1784938785.471056:0:33062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 41 00002000:00100000:1.0:1784938785.471067:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x14:0x0] (0->6429) req@ffff97473a636d80 x1871643326116480/t4294967324(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 6920/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938785.471087:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473a636d80 with x1871643326116480 ext(0->6429) 00002000:00010000:1.0:1784938785.471092:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473a636d80 00000100:00100000:1.0:1784938785.471117:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326116608 00000100:00100000:1.0:1784938785.471126:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326116608 00002000:00100000:1.0:1784938785.471151:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x15:0x0] (0->111138) req@ffff97473a637b80 x1871643326116608/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 488/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938785.471159:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473a637b80 with x1871643326116608 ext(0->111138) 00002000:00010000:1.0:1784938785.471163:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473a637b80 00000100:00100000:1.0:1784938785.471173:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326116992 00000100:00100000:1.0:1784938785.471176:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326116992 00002000:00100000:1.0:1784938785.471189:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x18:0x0] (0->422) req@ffff97473a635f80 x1871643326116992/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 912/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938785.471197:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473a635f80 with x1871643326116992 ext(0->422) 00002000:00010000:1.0:1784938785.471200:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473a635f80 00000100:00100000:1.0:1784938785.471207:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326116864 00000100:00100000:1.0:1784938785.471211:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326116864 00002000:00100000:1.0:1784938785.471236:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x17:0x0] (0->158095) req@ffff974703413100 x1871643326116864/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 488/0 e 0 to 0 dl 1784938796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938785.471244:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974703413100 with x1871643326116864 ext(0->158095) 00002000:00010000:1.0:1784938785.471248:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974703413100 00000100:00100000:0.0:1784938785.471507:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+200:25037:x1871643326117248:12345-192.168.202.4@tcp:35:cp.0 Request processed in 1811us (1884us total) trans 4294967425 rc 0/0 00000100:00100000:0.0:1784938785.471517:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:0.0:1784938785.471676:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:10025:x1871643326116352:12345-192.168.202.4@tcp:4:cp.0 Request processed in 2525us (28970us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1784938785.471684:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 42 00002000:00100000:0.0:1784938785.471691:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (0->1789) req@ffff974602690380 x1871643326116352/t4294967325(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 2280/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938785.471699:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974602690380 with x1871643326116352 ext(0->1789) 00002000:00010000:0.0:1784938785.471703:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974602690380 00000100:00100000:0.0:1784938785.471719:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:0.0:1784938785.471735:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+50:10023:x1871643326116608:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938785.472359:0:33062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:1.0:1784938785.472369:0:33062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473a635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+50:10026:x1871643326116992:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938785.472673:0:33062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+52:10026:x1871643326116992:12345-192.168.202.4@tcp:4:cp.0 Request processed in 305us (3083us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1784938785.472689:0:33062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 44 00002000:00100000:1.0:1784938785.472696:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x18:0x0] (0->422) req@ffff97473a635f80 x1871643326116992/t4294967326(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 912/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938785.472705:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473a635f80 with x1871643326116992 ext(0->422) 00002000:00010000:1.0:1784938785.472709:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473a635f80 00000100:00100000:1.0:1784938785.472725:0:33062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:1.0:1784938785.472732:0:33062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:10026:x1871643326116864:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938785.495696:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.495850:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326117376 00000100:00100000:1.0:1784938785.495861:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326117376 00000100:00100000:1.0:1784938785.495917:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 206 00000100:00100000:1.0:1784938785.495926:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+200:25037:x1871643326117376:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938785.495952:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938785.495972:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b400/0xcd9d312a94a085cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5da3 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.496035:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a085d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497375:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a085d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497389:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a085d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497413:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a085da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497439:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a085da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497446:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a085da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497505:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a085d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497512:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a085d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497519:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a085d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497526:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290bc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.497531:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a085d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497539:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a085d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497553:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.497557:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.497562:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a085d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497567:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a085d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497579:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a085da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497591:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a085da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497597:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a085da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497602:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.497605:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a085da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497612:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a085da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497621:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd13f1037 (ffff974702d24900) 00010000:00010000:1.0:1784938785.497623:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.497626:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a085da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497632:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a085da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.497677:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b400/0xcd9d312a94a085cc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5da3 expref: 201 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.498349:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.498352:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.498357:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b400/0xcd9d312a94a085cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5da3 expref: 201 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.498382:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290b400, rc 0) 00000100:00100000:1.0:1784938785.501502:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+200:25037:x1871643326117376:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5511us (6019us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938785.501515:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 206 00000100:00100000:0.0:1784938785.502207:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473a637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:10023:x1871643326116608:12345-192.168.202.4@tcp:4:cp.0 Request processed in 30470us (32651us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1784938785.502227:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 43 00002000:00100000:0.0:1784938785.502240:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x15:0x0] (0->111138) req@ffff97473a637b80 x1871643326116608/t4294967327(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 488/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938785.502322:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473a637b80 with x1871643326116608 ext(0->111138) 00002000:00010000:0.0:1784938785.502329:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473a637b80 00000100:00100000:1.0:1784938785.503722:0:33062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:10026:x1871643326116864:12345-192.168.202.4@tcp:4:cp.0 Request processed in 30982us (34112us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1784938785.503733:0:33062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 45 00002000:00100000:1.0:1784938785.503744:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x17:0x0] (0->158095) req@ffff974703413100 x1871643326116864/t4294967328(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:261/0 lens 488/448 e 0 to 0 dl 1784938796 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938785.504341:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974703413100 with x1871643326116864 ext(0->158095) 00002000:00010000:1.0:1784938785.504348:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974703413100 00000100:00100000:2.0:1784938785.506487:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.506621:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326117504 00000100:00100000:1.0:1784938785.506630:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326117504 00000100:00100000:1.0:1784938785.506721:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 207 00000100:00100000:1.0:1784938785.506731:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+200:25037:x1871643326117504:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938785.506769:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938785.506791:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a085e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5daa expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.506860:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a085e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.506876:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a085e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.506887:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a085e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507074:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a085ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507083:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a085ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507091:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a085ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507152:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a085e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507159:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a085e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507167:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a085e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507174:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.507178:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a085e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507187:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a085e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507199:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.507202:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.507206:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a085e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507213:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a085e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507371:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a085ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507379:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a085ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507385:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a085ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507389:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290ac00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.507392:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a085ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507398:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a085ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507406:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd13f1037 (ffff974702d24200) 00010000:00010000:1.0:1784938785.507408:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.507412:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a085ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507418:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a085ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507453:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a085e1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5daa expref: 201 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507464:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.507466:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.507477:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a085e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5daa expref: 201 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.507486:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a000, rc 0) 00000100:00100000:1.0:1784938785.507553:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+200:25037:x1871643326117504:12345-192.168.202.4@tcp:101:cp.0 Request processed in 823us (1074us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938785.507561:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 207 00000100:00100000:2.0:1784938785.513927:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.514449:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326117760 00000100:00100000:0.0:1784938785.514462:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326117760 00000100:00100000:0.0:1784938785.514526:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 208 00000100:00100000:0.0:1784938785.514538:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+200:25037:x1871643326117760:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.514559:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.514583:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a085f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5db1 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.514711:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a085fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.514729:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a085fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.514742:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a085fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.515397:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08604 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.515420:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.515429:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938785.517126:0:33061:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21:0x0], index 0: 0 00010000:00010000:1.0:1784938785.517961:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b400/0xcd9d312a94a0860b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.517981:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b400/0xcd9d312a94a0860b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.517993:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b400/0xcd9d312a94a0860b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.518034:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a085fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.518042:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a085fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.518048:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a085fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.518054:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.518059:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a085fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.518066:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a085fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.518099:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.518102:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.518107:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a085fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.518113:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a085fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938785.518129:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088ee8a63 reply state 000000005d04e7e9 transno 4294967426 ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938785.518138:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938785.518178:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a085f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5db1 expref: 203 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.518195:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b400/0xcd9d312a94a0860b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5db1 expref: 202 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.518202:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff974702d24900) 00010000:00010000:1.0:1784938785.518204:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938785.518207:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290b400, rc 0) 00000100:00100000:1.0:1784938785.518426:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+203:25037:x1871643326117760:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3888us (4515us total) trans 4294967426 rc 0/0 00000100:00100000:1.0:1784938785.518436:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 208 00010000:00010000:0.0:1784938785.520910:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.520926:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08604 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.520934:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.520940:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbe00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938785.520945:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.520954:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08604 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.520971:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd13f1037 (ffff974609f5d800) 00010000:00010000:0.0:1784938785.520974:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938785.520978:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08604 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.520984:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08604 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd13f1037 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.522949:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.523125:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326117888 00000100:00100000:3.0:1784938785.523135:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326117888 00000100:00100000:3.0:1784938785.523193:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 136 00000100:00100000:3.0:1784938785.523202:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:10023:x1871643326117888:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.523230:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.523262:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a08619 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5db8 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938785.523298:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938785.523320:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=939s v=(0 0) 00010000:00010000:3.0:1784938785.523324:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.523333:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a08619 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5db8 expref: 55 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.523350:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a08619 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5db8 expref: 55 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.523384:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045e00, rc 0) 00000100:00100000:3.0:1784938785.523446:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:10023:x1871643326117888:12345-192.168.202.4@tcp:101:cp.0 Request processed in 243us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938785.523453:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 136 00000100:00100000:1.0:1784938785.531247:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.531412:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326118016 00000100:00100000:3.0:1784938785.531423:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326118016 00000100:00100000:3.0:1784938785.531495:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 137 00000100:00100000:3.0:1784938785.531504:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:25037:x1871643326118016:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.531523:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.531542:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a08620 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5dbf expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.531576:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a08619 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5db8 expref: 56 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.531586:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.531590:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.531595:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a08620 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dbf expref: 56 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.531632:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a08619 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5db8 expref: 56 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.531648:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a08619 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5db8 expref: 56 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.531683:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703411500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342558592:192.168.202.4@tcp:104: 00000100:00100000:3.0:1784938785.531820:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474005b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938785.539162:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703411500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342558592:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938785.539202:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a08620 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->229375] (req 0->229375) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dbf expref: 56 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.539233:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045c00, rc 0) 00000100:00100000:3.0:1784938785.539399:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:25037:x1871643326118016:12345-192.168.202.4@tcp:101:cp.0 Request processed in 7894us (8161us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938785.539408:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 137 00000100:00100000:1.0:1784938785.540624:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.541150:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326118144 00000100:00100000:0.0:1784938785.541160:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326118144 00010000:00010000:1.0:1784938785.541320:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a08619 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5db8 expref: 56 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938785.541422:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:1.0:1784938785.541433:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:10023:x1871643326118144:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938785.541448:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938785.541475:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a08619 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5db8 expref: 56 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.541489:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a08619 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5db8 expref: 56 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.541513:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb287a54/0xcd9d312a94a08619 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5db8 expref: 56 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.541529:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938785.541534:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938785.541543:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a08620 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dbf expref: 55 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.541553:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a08620 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dbf expref: 55 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.541588:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a08620 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dbf expref: 55 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938785.541601:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c23800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342558720:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938785.541687:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1d780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938785.553911:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c23800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342558720:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938785.553958:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938785.554022:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:10023:x1871643326118144:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 12590us (13402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938785.554034:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:2.0:1784938785.557718:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.557894:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326118400 00000100:00100000:3.0:1784938785.557905:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326118400 00000100:00100000:3.0:1784938785.558007:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:3.0:1784938785.558020:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+202:25037:x1871643326118400:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938785.558397:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+203:25037:x1871643326118400:12345-192.168.202.4@tcp:35:cp.0 Request processed in 378us (688us total) trans 4294967427 rc 0/0 00000100:00100000:3.0:1784938785.558405:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:3.0:1784938785.562288:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.562364:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326118528 00000100:00100000:2.0:1784938785.562375:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326118528 00000100:00100000:2.0:1784938785.562437:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 209 00000100:00100000:2.0:1784938785.562448:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+203:25037:x1871643326118528:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938785.562475:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938785.562498:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a08627 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5dc6 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562567:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0862e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562584:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0862e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562595:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0862e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562609:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08635 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562616:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562622:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562706:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0862e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562713:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0862e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562719:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0862e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562725:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.562729:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0862e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562737:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0862e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562786:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.562790:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.562794:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0862e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562800:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0862e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562813:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562819:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08635 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562825:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562837:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.562840:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562846:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08635 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562855:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc701cb36 (ffff9747029bb600) 00010000:00010000:2.0:1784938785.562857:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.562859:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08635 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562865:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08635 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562900:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a08627 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dc6 expref: 204 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562910:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.562913:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.562917:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a08627 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dc6 expref: 204 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.562926:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893200, rc 0) 00000100:00100000:2.0:1784938785.562985:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+203:25037:x1871643326118528:12345-192.168.202.4@tcp:101:cp.0 Request processed in 539us (716us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938785.562993:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 209 00000100:00100000:1.0:1784938785.565614:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.565700:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326118656 00000100:00100000:3.0:1784938785.565709:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326118656 00000100:00100000:0.0:1784938785.565931:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 210 00000100:00100000:0.0:1784938785.565945:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+203:25037:x1871643326118656:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.565966:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.565987:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0863c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5dcd expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566055:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08643 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566068:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566079:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566326:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a0864a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566336:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a0864a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566345:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a0864a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566412:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566419:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08643 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566438:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566444:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddaa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938785.566448:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566455:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08643 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566467:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938785.566470:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938785.566475:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08643 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566481:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddaa00/0xcd9d312a94a08643 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566494:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a0864a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566500:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a0864a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566505:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a0864a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566510:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddb600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938785.566513:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a0864a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566529:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a0864a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566538:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc701cb36 (ffff974609f5d800) 00010000:00010000:0.0:1784938785.566540:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938785.566544:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a0864a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566550:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a0864a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566590:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0863c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dcd expref: 204 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566601:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938785.566604:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938785.566608:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0863c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dcd expref: 204 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.566617:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddbc00, rc 0) 00000100:00100000:0.0:1784938785.566688:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+203:25037:x1871643326118656:12345-192.168.202.4@tcp:101:cp.0 Request processed in 747us (1083us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938785.566697:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 210 00000100:00100000:0.0:1784938785.571096:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.571170:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326118912 00000100:00100000:2.0:1784938785.571196:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326118912 00000100:00100000:2.0:1784938785.571410:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 211 00000100:00100000:2.0:1784938785.571421:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+203:25037:x1871643326118912:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938785.571443:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938785.571465:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a08651 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5dd4 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.571597:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08658 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.571612:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08658 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.571625:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08658 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.571639:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0865f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.571647:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0865f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.571654:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0865f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938785.572125:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21:0x0], index 1: 0 00010000:00010000:2.0:1784938785.572307:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892400/0xcd9d312a94a08666 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.572318:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892400/0xcd9d312a94a08666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.572338:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892400/0xcd9d312a94a08666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.572380:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08658 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.572386:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08658 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.572392:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08658 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.572398:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.572402:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08658 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.572408:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08658 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.572420:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.572423:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.572428:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08658 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.572433:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08658 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938785.572447:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d96294d7 reply state 00000000a6ca3b4b transno 4294967428 ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0865f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.572456:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938785.572493:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a08651 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dd4 expref: 206 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.572508:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892400/0xcd9d312a94a08666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dd4 expref: 205 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.572516:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9747029bbd00) 00010000:00010000:2.0:1784938785.572519:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938785.572522:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892400, rc 0) 00000100:00100000:2.0:1784938785.572606:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+206:25037:x1871643326118912:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1186us (1518us total) trans 4294967428 rc 0/0 00000100:00100000:2.0:1784938785.572614:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 211 00010000:00010000:2.0:1784938785.577620:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0865f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.577639:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0865f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.577648:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0865f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.577654:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.577659:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0865f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.577668:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0865f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.577685:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc701cb36 (ffff9747029bb600) 00010000:00010000:2.0:1784938785.577688:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.577714:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0865f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.577722:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a0865f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc701cb36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938785.579071:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.579262:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326119040 00000100:00100000:2.0:1784938785.579272:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326119040 00000100:00100000:2.0:1784938785.579336:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 138 00000100:00100000:2.0:1784938785.579345:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:10025:x1871643326119040:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938785.579366:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938785.579390:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08674 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ddb expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938785.579420:0:33065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938785.579441:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=939s v=(0 0) 00010000:00010000:2.0:1784938785.579446:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.579456:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08674 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ddb expref: 55 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.579473:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08674 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ddb expref: 55 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.579487:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893c00, rc 0) 00000100:00100000:2.0:1784938785.579559:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:10025:x1871643326119040:12345-192.168.202.4@tcp:101:cp.0 Request processed in 214us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938785.579567:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 138 00000100:00100000:0.0:1784938785.583550:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.583638:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326119168 00000100:00100000:3.0:1784938785.583648:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326119168 00000100:00100000:3.0:1784938785.583733:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 139 00000100:00100000:3.0:1784938785.583743:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:25037:x1871643326119168:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938785.583962:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938785.583987:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0867b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5de2 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.584020:0:31428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08674 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ddb expref: 56 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.584030:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.584034:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.584040:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0867b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5de2 expref: 56 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.584071:0:31428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08674 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ddb expref: 56 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.584086:0:31428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08674 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ddb expref: 56 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.584102:0:31428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746026a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342558848:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938785.584189:0:31428:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938785.589056:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.589146:0:31428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746026a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342558848:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938785.589196:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0867b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5de2 expref: 56 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.589229:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893400, rc 0) 00000100:00100000:0.0:1784938785.589305:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:25037:x1871643326119168:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5562us (5764us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.589315:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 139 00000100:00100000:3.0:1784938785.590998:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326119296 00000100:00100000:3.0:1784938785.591010:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326119296 00010000:00010000:3.0:1784938785.591052:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08674 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ddb expref: 56 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.591155:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:3.0:1784938785.591166:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:10025:x1871643326119296:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938785.591181:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938785.591203:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08674 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ddb expref: 56 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.591229:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08674 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ddb expref: 56 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.591262:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08674 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ddb expref: 56 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.591287:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.591291:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.591300:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0867b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5de2 expref: 55 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.591311:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0867b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5de2 expref: 55 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.591371:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0867b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5de2 expref: 55 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.591385:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974703411500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342558976:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938785.591466:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474005ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938785.598413:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.598545:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974703411500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342558976:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938785.598572:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938785.598633:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:10025:x1871643326119296:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7468us (9585us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938785.598644:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:0.0:1784938785.599086:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326119552 00000100:00100000:0.0:1784938785.599093:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326119552 00000100:00100000:0.0:1784938785.599143:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:0.0:1784938785.599151:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+205:25037:x1871643326119552:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938785.599512:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+206:25037:x1871643326119552:12345-192.168.202.4@tcp:35:cp.0 Request processed in 360us (1108us total) trans 4294967429 rc 0/0 00000100:00100000:0.0:1784938785.599519:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:2.0:1784938785.603692:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.604053:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326119680 00000100:00100000:1.0:1784938785.604063:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326119680 00000100:00100000:1.0:1784938785.604125:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 212 00000100:00100000:1.0:1784938785.604135:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+206:25037:x1871643326119680:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938785.604159:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938785.604180:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b200/0xcd9d312a94a08682 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5de9 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.606991:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08689 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607014:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08689 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607028:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08689 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607044:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08690 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607052:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607059:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607127:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08689 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607155:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08689 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607162:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08689 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607167:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290be00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.607172:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08689 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607179:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08689 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607190:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.607193:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.607197:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08689 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607203:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08689 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607226:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607232:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08690 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607504:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607511:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.607521:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607528:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08690 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607538:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x322afea2 (ffff974702d24200) 00010000:00010000:1.0:1784938785.607541:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.607544:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08690 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607550:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08690 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607594:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b200/0xcd9d312a94a08682 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5de9 expref: 207 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607604:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.607606:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.607610:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b200/0xcd9d312a94a08682 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5de9 expref: 207 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.607620:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290b200, rc 0) 00000100:00100000:1.0:1784938785.607695:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+206:25037:x1871643326119680:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3559us (4012us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938785.607704:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 212 00000100:00100000:2.0:1784938785.615715:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.615831:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326119808 00000100:00100000:1.0:1784938785.615841:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326119808 00000100:00100000:1.0:1784938785.615918:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 213 00000100:00100000:1.0:1784938785.615928:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+206:25037:x1871643326119808:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938785.615968:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938785.615990:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b200/0xcd9d312a94a08697 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5df0 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616065:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0869e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616081:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0869e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616093:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0869e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616108:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a086a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616115:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a086a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616121:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a086a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616184:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0869e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616192:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0869e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616199:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0869e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616204:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.616224:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0869e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616233:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0869e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616694:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.616698:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.616704:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0869e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616711:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0869e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616725:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a086a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616730:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a086a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616735:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a086a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616740:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290be00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.616743:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a086a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.616748:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a086a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.617014:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x322afea2 (ffff974702d24200) 00010000:00010000:1.0:1784938785.617017:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.617033:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a086a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.617038:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a086a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.617081:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b200/0xcd9d312a94a08697 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5df0 expref: 207 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.617091:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.617094:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.617098:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b200/0xcd9d312a94a08697 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5df0 expref: 207 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.617107:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290b200, rc 0) 00000100:00100000:1.0:1784938785.617929:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+206:25037:x1871643326119808:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1996us (2220us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938785.617939:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 213 00000100:00100000:0.0:1784938785.634524:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.635046:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326120064 00000100:00100000:2.0:1784938785.635057:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326120064 00000100:00100000:2.0:1784938785.635119:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 214 00000100:00100000:2.0:1784938785.635130:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+206:25037:x1871643326120064:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938785.635167:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938785.635187:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a086ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5df7 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.635409:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.635425:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.635436:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.635452:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a086ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x322afea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.635460:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a086ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.635467:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a086ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938785.636030:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1784938785.636190:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893e00/0xcd9d312a94a086c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.636201:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893e00/0xcd9d312a94a086c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.636209:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893e00/0xcd9d312a94a086c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.636340:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.636349:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.636356:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.636362:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.636367:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.636376:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.636389:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.636392:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.636397:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.636404:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938785.636418:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000789e8d3f reply state 00000000cccbbb48 transno 4294967430 ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a086ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.636427:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938785.636457:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a086ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5df7 expref: 209 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.636486:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893e00/0xcd9d312a94a086c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5df7 expref: 208 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.636493:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff97472ff12200) 00010000:00010000:2.0:1784938785.636496:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938785.636499:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893e00, rc 0) 00000100:00100000:2.0:1784938785.636622:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+209:25037:x1871643326120064:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1493us (2107us total) trans 4294967430 rc 0/0 00000100:00100000:2.0:1784938785.636631:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 214 00010000:00010000:0.0:1784938785.641858:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a086ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.641876:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a086ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.641884:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a086ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.641890:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938785.641894:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a086ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.641921:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a086ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.641938:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x322afea2 (ffff97472ff12600) 00010000:00010000:0.0:1784938785.641941:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938785.641946:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a086ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.641952:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a086ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x322afea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.642422:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.642516:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326120192 00000100:00100000:2.0:1784938785.642526:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326120192 00000100:00100000:2.0:1784938785.642608:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 140 00000100:00100000:2.0:1784938785.642619:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:10023:x1871643326120192:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938785.642636:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938785.642657:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a086cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5dfe expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938785.642682:0:33065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938785.642701:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=939s v=(0 0) 00010000:00010000:2.0:1784938785.642706:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.642715:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a086cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dfe expref: 56 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.642732:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a086cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dfe expref: 56 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.642842:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892800, rc 0) 00000100:00100000:2.0:1784938785.642899:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:10023:x1871643326120192:12345-192.168.202.4@tcp:101:cp.0 Request processed in 282us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938785.642907:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 140 00000100:00100000:2.0:1784938785.647904:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.648018:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326120320 00000100:00100000:0.0:1784938785.648029:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326120320 00000100:00100000:0.0:1784938785.648089:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 141 00000100:00100000:0.0:1784938785.648100:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:25037:x1871643326120320:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.648118:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.648138:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb09303f/0xcd9d312a94a086d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e05 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.648169:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a086cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dfe expref: 57 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.648179:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.648189:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.648194:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb09303f/0xcd9d312a94a086d6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e05 expref: 57 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.648238:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a086cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dfe expref: 57 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.648339:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a086cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dfe expref: 57 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938785.648356:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342559104:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938785.648490:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747061f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938785.651296:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.651467:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342559104:192.168.202.4@tcp:104: 00010000:00010000:3.0:1784938785.651509:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb09303f/0xcd9d312a94a086d6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e05 expref: 57 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.651536:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddaa00, rc 0) 00000100:00100000:3.0:1784938785.651638:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:25037:x1871643326120320:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3539us (3742us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938785.651648:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 141 00000100:00100000:2.0:1784938785.651668:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326120448 00000100:00100000:2.0:1784938785.651674:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326120448 00010000:00010000:2.0:1784938785.651704:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a086cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dfe expref: 57 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.651741:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:2.0:1784938785.651749:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10023:x1871643326120448:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938785.651783:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938785.651805:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a086cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dfe expref: 57 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.651819:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a086cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dfe expref: 57 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.651841:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a086cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dfe expref: 57 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.651855:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.651859:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.651884:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb09303f/0xcd9d312a94a086d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e05 expref: 56 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.651894:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb09303f/0xcd9d312a94a086d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e05 expref: 56 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.651945:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000eb09303f/0xcd9d312a94a086d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e05 expref: 56 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.651958:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746026a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342559232:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938785.652008:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938785.654574:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746026a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342559232:192.168.202.4@tcp:105: 00010000:00010000:2.0:1784938785.654600:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938785.654701:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:10023:x1871643326120448:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2950us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938785.654712:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:0.0:1784938785.660649:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.660922:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326120704 00000100:00100000:3.0:1784938785.660933:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326120704 00000100:00100000:3.0:1784938785.660991:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:3.0:1784938785.661002:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+208:25037:x1871643326120704:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938785.661555:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+209:25037:x1871643326120704:12345-192.168.202.4@tcp:35:cp.0 Request processed in 553us (913us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1784938785.661564:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:1.0:1784938785.666109:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.666412:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326120832 00000100:00100000:2.0:1784938785.666422:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326120832 00000100:00100000:2.0:1784938785.666482:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 215 00000100:00100000:2.0:1784938785.666491:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+209:25037:x1871643326120832:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938785.666517:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938785.666537:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a086dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e0c expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.666602:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a086e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.666639:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a086e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.666651:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a086e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.666667:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.666674:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.666680:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.666748:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a086e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.666987:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a086e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.666996:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a086e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667002:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.667007:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a086e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667015:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a086e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667027:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.667036:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.667042:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a086e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667049:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a086e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667064:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667070:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667077:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667083:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.667086:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667093:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667100:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xaa0c2c16 (ffff97472ff12500) 00010000:00010000:2.0:1784938785.667102:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.667105:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667111:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a086eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667145:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a086dd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e0c expref: 210 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667162:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.667165:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.667169:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a086dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e0c expref: 210 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.667181:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892800, rc 0) 00000100:00100000:2.0:1784938785.667654:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+209:25037:x1871643326120832:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1162us (1551us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938785.667664:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 215 00000100:00100000:1.0:1784938785.672613:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.672707:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326120960 00000100:00100000:2.0:1784938785.672717:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326120960 00000100:00100000:2.0:1784938785.672902:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 216 00000100:00100000:2.0:1784938785.672922:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+209:25037:x1871643326120960:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938785.672943:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938785.672964:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a086f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e13 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673031:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a086f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673048:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a086f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673060:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a086f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673074:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08700 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673096:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673103:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673170:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a086f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673179:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a086f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673185:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a086f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673192:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.673197:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a086f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673205:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a086f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673229:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.673233:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.673246:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a086f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673259:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a086f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673273:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673293:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08700 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673300:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673306:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.673309:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673317:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08700 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673325:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xaa0c2c16 (ffff97472ff12a00) 00010000:00010000:2.0:1784938785.673328:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.673331:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08700 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673337:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08700 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673370:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a086f2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e13 expref: 210 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673379:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938785.673382:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.673385:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a086f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e13 expref: 210 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.673406:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893c00, rc 0) 00000100:00100000:2.0:1784938785.673468:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+209:25037:x1871643326120960:12345-192.168.202.4@tcp:101:cp.0 Request processed in 549us (867us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938785.673476:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 216 00000100:00100000:0.0:1784938785.677608:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.677696:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326121216 00000100:00100000:1.0:1784938785.677705:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326121216 00000100:00100000:1.0:1784938785.677791:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 217 00000100:00100000:1.0:1784938785.677801:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+209:25037:x1871643326121216:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938785.677822:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938785.677841:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08707 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e1a expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.677974:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0870e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.678005:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0870e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.678017:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0870e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.678033:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08715 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.678040:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.678047:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938785.678510:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1784938785.678661:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b200/0xcd9d312a94a0871c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.678672:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b200/0xcd9d312a94a0871c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.678680:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b200/0xcd9d312a94a0871c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.678711:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0870e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.678719:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0870e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.678727:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0870e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.678739:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.678744:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0870e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.679230:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0870e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.679332:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.679336:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.679342:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0870e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.679349:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a0870e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938785.679364:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000594ddb3d reply state 000000002af8edd0 transno 4294967432 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938785.679373:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938785.679409:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08707 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e1a expref: 212 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.679424:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b200/0xcd9d312a94a0871c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e1a expref: 211 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.679432:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff974702d24400) 00010000:00010000:1.0:1784938785.679434:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938785.679437:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290b200, rc 0) 00000100:00100000:1.0:1784938785.679586:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+212:25037:x1871643326121216:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1785us (1985us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1784938785.679603:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 217 00010000:00010000:2.0:1784938785.682505:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.682523:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08715 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.682532:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08715 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.682538:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290be00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.682544:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08715 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.682553:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08715 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.682570:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xaa0c2c16 (ffff974702d24200) 00010000:00010000:2.0:1784938785.682573:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.682578:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08715 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.682584:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08715 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xaa0c2c16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938785.688581:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.690983:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326121344 00000100:00100000:3.0:1784938785.690998:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326121344 00000100:00100000:3.0:1784938785.691138:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 142 00000100:00100000:3.0:1784938785.691149:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+55:10026:x1871643326121344:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.691167:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.691188:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000313270bf/0xcd9d312a94a0872a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e21 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938785.691223:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938785.691253:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=939s v=(0 0) 00010000:00010000:3.0:1784938785.691257:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.691267:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000313270bf/0xcd9d312a94a0872a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e21 expref: 56 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.691289:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000313270bf/0xcd9d312a94a0872a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e21 expref: 56 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.691303:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045200, rc 0) 00000100:00100000:3.0:1784938785.691368:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:10026:x1871643326121344:12345-192.168.202.4@tcp:101:cp.0 Request processed in 220us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938785.691375:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 142 00000100:00100000:1.0:1784938785.695885:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.696056:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326121472 00000100:00100000:2.0:1784938785.696084:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326121472 00000100:00100000:2.0:1784938785.696143:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 143 00000100:00100000:2.0:1784938785.696153:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:25037:x1871643326121472:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938785.696172:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938785.696191:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08731 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e28 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.696232:0:31428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000313270bf/0xcd9d312a94a0872a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e21 expref: 57 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.696255:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.696260:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.696266:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08731 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e28 expref: 57 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.696459:0:31428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000313270bf/0xcd9d312a94a0872a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e21 expref: 57 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.696476:0:31428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000313270bf/0xcd9d312a94a0872a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e21 expref: 57 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.696491:0:31428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746026a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342559360:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938785.697185:0:31428:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938785.704619:0:31428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746026a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342559360:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938785.704656:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08731 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->258047] (req 0->258047) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e28 expref: 57 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.704701:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893c00, rc 0) 00000100:00100000:2.0:1784938785.704898:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:25037:x1871643326121472:12345-192.168.202.4@tcp:101:cp.0 Request processed in 8745us (9021us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938785.704908:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 143 00000100:00100000:1.0:1784938785.714604:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.718021:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326121600 00000100:00100000:0.0:1784938785.718037:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326121600 00010000:00010000:0.0:1784938785.718088:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000313270bf/0xcd9d312a94a0872a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e21 expref: 57 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938785.718196:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:0.0:1784938785.718207:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10025:x1871643326121600:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938785.718234:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938785.719232:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000313270bf/0xcd9d312a94a0872a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e21 expref: 57 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.719266:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000313270bf/0xcd9d312a94a0872a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e21 expref: 57 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.719300:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000313270bf/0xcd9d312a94a0872a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e21 expref: 57 pid: 31425 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.719340:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.719344:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.719352:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e28 expref: 56 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.719362:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08731 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e28 expref: 56 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.719403:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08731 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e28 expref: 56 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938785.719416:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342559488:192.168.202.4@tcp:105: 00000100:00100000:0.0:1784938785.719499:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747061f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938785.731187:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342559488:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938785.731227:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938785.731409:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:10025:x1871643326121600:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 13201us (16813us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.731421:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:3.0:1784938785.749592:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.749874:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326121856 00000100:00100000:0.0:1784938785.749884:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326121856 00000100:00100000:0.0:1784938785.749954:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:0.0:1784938785.749965:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+211:25037:x1871643326121856:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938785.750347:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+212:25037:x1871643326121856:12345-192.168.202.4@tcp:35:cp.0 Request processed in 382us (764us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1784938785.750368:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:2.0:1784938785.756476:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.756590:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326121984 00000100:00100000:0.0:1784938785.756603:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326121984 00000100:00100000:0.0:1784938785.756665:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 218 00000100:00100000:0.0:1784938785.756676:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+212:25037:x1871643326121984:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.756703:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.756728:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08738 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e2f expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.756831:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a0873f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.756845:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a0873f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.756856:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a0873f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.756870:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08746 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.756877:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.756884:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758443:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a0873f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758479:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a0873f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758487:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a0873f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758494:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938785.758499:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a0873f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758507:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a0873f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758522:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938785.758525:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938785.758530:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a0873f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758537:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a0873f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758552:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758559:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08746 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758566:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758572:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938785.758581:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758588:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08746 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758597:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd47b514a (ffff974609f5d800) 00010000:00010000:0.0:1784938785.758600:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938785.758603:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08746 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758609:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda000/0xcd9d312a94a08746 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758655:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08738 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e2f expref: 213 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758667:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938785.758669:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938785.758674:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08738 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e2f expref: 213 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.758685:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddb800, rc 0) 00000100:00100000:0.0:1784938785.758873:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+212:25037:x1871643326121984:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2197us (2407us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938785.758883:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 218 00000100:00100000:3.0:1784938785.773852:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.774009:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326122112 00000100:00100000:1.0:1784938785.774019:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326122112 00000100:00100000:1.0:1784938785.774087:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 219 00000100:00100000:1.0:1784938785.774098:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+212:25037:x1871643326122112:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938785.774122:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938785.774145:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0874d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e36 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774228:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08754 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774251:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774263:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774277:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a0875b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774293:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a0875b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774299:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a0875b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774385:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774392:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08754 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774397:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774403:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.774408:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774415:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08754 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774427:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.774431:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.774436:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08754 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774441:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08754 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774454:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a0875b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774460:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a0875b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774465:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a0875b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774478:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290ac00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.774481:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a0875b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774488:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a0875b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774495:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd47b514a (ffff974702d24f00) 00010000:00010000:1.0:1784938785.774498:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.774501:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a0875b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774506:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a0875b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774542:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0874d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e36 expref: 213 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774553:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.774555:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.774559:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0874d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e36 expref: 213 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.774568:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a800, rc 0) 00000100:00100000:1.0:1784938785.774638:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+212:25037:x1871643326122112:12345-192.168.202.4@tcp:101:cp.0 Request processed in 541us (794us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938785.774646:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 219 00000100:00100000:2.0:1784938785.778802:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.778891:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326122368 00000100:00100000:1.0:1784938785.778926:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326122368 00000100:00100000:1.0:1784938785.778983:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 220 00000100:00100000:1.0:1784938785.778992:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+212:25037:x1871643326122368:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938785.779014:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938785.779037:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a08762 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e3d expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.779195:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08769 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.779222:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08769 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.779235:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08769 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.779258:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08770 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xd47b514a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.779266:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.779273:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938785.779813:0:33061:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23:0x0], index 0: 0 00010000:00010000:1.0:1784938785.779978:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08777 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.779989:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.780010:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.780046:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08769 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.780053:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08769 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.780061:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08769 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.780067:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.780072:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08769 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.780080:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08769 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.780093:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.780095:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.780100:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08769 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.780106:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08769 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938785.780118:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b97a61e reply state 00000000e164df59 transno 4294967434 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938785.780127:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938785.780165:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a08762 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e3d expref: 215 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.780180:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e3d expref: 214 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.780188:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff974702d24e00) 00010000:00010000:1.0:1784938785.780191:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938785.780194:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290aa00, rc 0) 00000100:00100000:1.0:1784938785.780272:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+215:25037:x1871643326122368:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1281us (1521us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1784938785.780280:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 220 00010000:00010000:0.0:1784938785.782723:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.782742:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08770 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.782794:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08770 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.782801:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938785.782806:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08770 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.782815:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08770 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.782833:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd47b514a (ffff974702d24b00) 00010000:00010000:0.0:1784938785.782836:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938785.782840:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08770 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.782847:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08770 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd47b514a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.786934:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.787007:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326122496 00000100:00100000:0.0:1784938785.787017:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326122496 00000100:00100000:0.0:1784938785.787067:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 144 00000100:00100000:0.0:1784938785.787076:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:10023:x1871643326122496:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.787095:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.787119:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a72d4dbe/0xcd9d312a94a08785 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e44 expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938785.787148:0:33065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938785.787168:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=939s v=(0 0) 00010000:00010000:0.0:1784938785.787188:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.787198:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a72d4dbe/0xcd9d312a94a08785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e44 expref: 57 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.787229:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a72d4dbe/0xcd9d312a94a08785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e44 expref: 57 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.787244:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddb800, rc 0) 00000100:00100000:0.0:1784938785.787325:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10023:x1871643326122496:12345-192.168.202.4@tcp:101:cp.0 Request processed in 250us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.787331:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 144 00000100:00100000:3.0:1784938785.791384:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.791507:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326122624 00000100:00100000:0.0:1784938785.791517:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326122624 00000100:00100000:0.0:1784938785.791579:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 145 00000100:00100000:0.0:1784938785.791589:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:25037:x1871643326122624:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.791609:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.791629:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a034279/0xcd9d312a94a0878c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e4b expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.791663:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a72d4dbe/0xcd9d312a94a08785 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e44 expref: 58 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.791672:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.791677:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.791682:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a034279/0xcd9d312a94a0878c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e4b expref: 58 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.791738:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a72d4dbe/0xcd9d312a94a08785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e44 expref: 58 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.791777:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a72d4dbe/0xcd9d312a94a08785 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e44 expref: 58 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938785.791791:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342559616:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938785.791879:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473567b180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938785.795416:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342559616:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938785.795465:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a034279/0xcd9d312a94a0878c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->45055] (req 0->45055) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e4b expref: 58 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.795490:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602dda000, rc 0) 00000100:00100000:0.0:1784938785.795564:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:25037:x1871643326122624:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3975us (4191us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.795574:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 145 00000100:00100000:3.0:1784938785.798042:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.798138:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326122752 00000100:00100000:2.0:1784938785.798150:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326122752 00010000:00010000:2.0:1784938785.798188:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a72d4dbe/0xcd9d312a94a08785 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e44 expref: 58 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.798261:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:2.0:1784938785.798272:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703411c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10023:x1871643326122752:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938785.798303:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938785.798331:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a72d4dbe/0xcd9d312a94a08785 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e44 expref: 58 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.798347:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a72d4dbe/0xcd9d312a94a08785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e44 expref: 58 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.798372:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a72d4dbe/0xcd9d312a94a08785 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e44 expref: 58 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.798416:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.798420:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.798430:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a034279/0xcd9d312a94a0878c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e4b expref: 57 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.798441:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a034279/0xcd9d312a94a0878c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e4b expref: 57 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.798485:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006a034279/0xcd9d312a94a0878c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e4b expref: 57 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.798500:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746026a0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342559744:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938785.798982:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938785.804195:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.804287:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326123008 00000100:00100000:3.0:1784938785.804298:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326123008 00000100:00100000:3.0:1784938785.804359:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:3.0:1784938785.804369:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+214:25037:x1871643326123008:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938785.804738:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+215:25037:x1871643326123008:12345-192.168.202.4@tcp:35:cp.0 Request processed in 369us (552us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1784938785.804746:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:1.0:1784938785.809934:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746026a0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342559744:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938785.809964:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938785.812986:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703411c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10023:x1871643326122752:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 14702us (14939us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938785.813006:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:2.0:1784938785.818613:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.819473:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326123136 00000100:00100000:1.0:1784938785.819485:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326123136 00000100:00100000:1.0:1784938785.819558:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 221 00000100:00100000:1.0:1784938785.819569:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+215:25037:x1871643326123136:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938785.819595:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938785.819618:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a08793 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e52 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819687:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a0879a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819723:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a0879a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819735:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a0879a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819775:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819783:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819789:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819859:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a0879a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819867:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a0879a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819875:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a0879a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819882:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.819887:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a0879a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819895:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a0879a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819907:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.819916:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.819922:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a0879a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819929:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a0879a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819943:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819950:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819957:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819962:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.819966:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819973:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819980:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x7772308b (ffff974702d24f00) 00010000:00010000:1.0:1784938785.819983:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.819986:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.819992:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.820026:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a08793 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e52 expref: 216 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.820042:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.820044:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.820048:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a08793 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e52 expref: 216 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.820058:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a000, rc 0) 00000100:00100000:1.0:1784938785.820112:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+215:25037:x1871643326123136:12345-192.168.202.4@tcp:101:cp.0 Request processed in 546us (1509us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938785.820120:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 221 00000100:00100000:2.0:1784938785.826129:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.828972:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326123264 00000100:00100000:1.0:1784938785.828986:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326123264 00000100:00100000:1.0:1784938785.829089:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 222 00000100:00100000:1.0:1784938785.829100:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+215:25037:x1871643326123264:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938785.829121:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938785.829143:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a087a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e59 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829227:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829249:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829262:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829582:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a087b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829607:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a087b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829616:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a087b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829687:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829695:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829702:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829709:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.829713:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829721:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829735:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.829738:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.829743:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829795:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829808:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a087b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829821:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a087b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829828:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a087b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829833:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.829837:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a087b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829844:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a087b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829853:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x7772308b (ffff974702d24f00) 00010000:00010000:1.0:1784938785.829855:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.829859:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a087b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829865:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a087b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829901:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a087a8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e59 expref: 216 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829911:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.829913:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.829917:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a087a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e59 expref: 216 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.829938:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a000, rc 0) 00000100:00100000:1.0:1784938785.830005:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+215:25037:x1871643326123264:12345-192.168.202.4@tcp:101:cp.0 Request processed in 907us (3886us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938785.830014:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 222 00000100:00100000:2.0:1784938785.835247:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.835377:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326123520 00000100:00100000:3.0:1784938785.835387:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326123520 00000100:00100000:3.0:1784938785.835441:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 223 00000100:00100000:3.0:1784938785.835451:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+215:25037:x1871643326123520:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938785.835472:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938785.835494:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a087bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e60 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.835623:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a087c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.835638:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a087c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.835650:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a087c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.835666:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a087cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x7772308b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.835695:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a087cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.835703:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a087cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938785.836205:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23:0x0], index 1: 0 00010000:00010000:3.0:1784938785.836446:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044a00/0xcd9d312a94a087d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.836457:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044a00/0xcd9d312a94a087d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.836466:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044a00/0xcd9d312a94a087d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.836500:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a087c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.836507:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a087c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.836513:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a087c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.836519:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938785.836524:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a087c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.836533:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a087c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.836560:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938785.836563:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938785.836568:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a087c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.836574:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a087c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938785.836589:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d56af89a reply state 00000000357bde8b transno 4294967436 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a087cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.836597:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938785.836628:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a087bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e60 expref: 218 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.836642:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044a00/0xcd9d312a94a087d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e60 expref: 217 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.836649:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9747214caf00) 00010000:00010000:3.0:1784938785.836651:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938785.836654:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742044a00, rc 0) 00000100:00100000:3.0:1784938785.836718:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+218:25037:x1871643326123520:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1268us (1488us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1784938785.836727:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 223 00010000:00010000:2.0:1784938785.840007:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a087cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.840025:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a087cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.840034:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a087cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.840060:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.840065:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a087cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.840074:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a087cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.840091:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x7772308b (ffff9747214caa00) 00010000:00010000:2.0:1784938785.840095:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.840099:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a087cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.840106:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a087cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x7772308b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.841500:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.841692:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326123648 00000100:00100000:0.0:1784938785.841704:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326123648 00000100:00100000:0.0:1784938785.841799:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 146 00000100:00100000:0.0:1784938785.841811:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:10025:x1871643326123648:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.841833:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.841858:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a72d4dbe/0xcd9d312a94a087e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e67 expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938785.841905:0:33065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938785.841928:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=939s v=(0 0) 00010000:00010000:0.0:1784938785.841934:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.841944:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a72d4dbe/0xcd9d312a94a087e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e67 expref: 57 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.841962:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a72d4dbe/0xcd9d312a94a087e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e67 expref: 57 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.841977:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddb800, rc 0) 00000100:00100000:0.0:1784938785.842036:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10025:x1871643326123648:12345-192.168.202.4@tcp:101:cp.0 Request processed in 227us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.842044:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 146 00000100:00100000:3.0:1784938785.852877:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938785.852988:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326123776 00000100:00100000:2.0:1784938785.853001:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326123776 00000100:00100000:2.0:1784938785.853058:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 147 00000100:00100000:2.0:1784938785.853067:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703413480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:25037:x1871643326123776:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938785.853087:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938785.853107:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a087e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e6e expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.853149:0:31428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a72d4dbe/0xcd9d312a94a087e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e67 expref: 58 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.853160:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.853186:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938785.853193:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a087e7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e6e expref: 58 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.853258:0:31428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a72d4dbe/0xcd9d312a94a087e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e67 expref: 58 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.853275:0:31428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a72d4dbe/0xcd9d312a94a087e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e67 expref: 58 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938785.853301:0:31428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746026a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342559872:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938785.853409:0:31428:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938785.860941:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.861111:0:31428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746026a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342559872:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938785.861148:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a087e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->430079] (req 0->430079) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e6e expref: 58 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.861172:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893200, rc 0) 00000100:00100000:0.0:1784938785.861251:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703413480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:25037:x1871643326123776:12345-192.168.202.4@tcp:101:cp.0 Request processed in 8183us (8385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.861260:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 147 00000100:00100000:3.0:1784938785.861927:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326123904 00000100:00100000:3.0:1784938785.861936:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326123904 00010000:00010000:3.0:1784938785.861971:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a72d4dbe/0xcd9d312a94a087e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e67 expref: 58 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.862032:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:3.0:1784938785.862040:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10026:x1871643326123904:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938785.862055:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938785.862078:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a72d4dbe/0xcd9d312a94a087e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e67 expref: 58 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.862092:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a72d4dbe/0xcd9d312a94a087e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e67 expref: 58 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.862116:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a72d4dbe/0xcd9d312a94a087e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e67 expref: 58 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.862134:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.862138:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938785.862145:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a087e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e6e expref: 57 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.862155:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a087e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e6e expref: 57 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938785.862195:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a087e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e6e expref: 57 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.862208:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603683480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342560000:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938785.862646:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474005ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938785.876495:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603683480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342560000:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938785.876525:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938785.876589:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10026:x1871643326123904:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 14549us (15658us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938785.876601:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:2.0:1784938785.888431:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938785.888522:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326124160 00000100:00100000:3.0:1784938785.888533:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326124160 00000100:00100000:3.0:1784938785.888598:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:3.0:1784938785.888608:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+217:25037:x1871643326124160:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:3.0:1784938785.889018:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+218:25037:x1871643326124160:12345-192.168.202.4@tcp:35:cp.0 Request processed in 409us (594us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1784938785.889028:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:1.0:1784938785.917382:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.917587:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326124288 00000100:00100000:0.0:1784938785.917598:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326124288 00000100:00100000:0.0:1784938785.917651:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 224 00000100:00100000:0.0:1784938785.917675:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+218:25037:x1871643326124288:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.917701:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.917722:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a087ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e75 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918051:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918065:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918076:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918090:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a087fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918097:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a087fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918103:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a087fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918162:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918169:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918175:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918188:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.918193:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918201:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918222:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.918226:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.918230:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918237:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a087f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918250:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a087fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918256:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a087fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918262:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a087fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918267:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290ac00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.918270:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a087fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918282:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a087fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918299:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe087ee79 (ffff974702d24f00) 00010000:00010000:1.0:1784938785.918301:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.918304:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a087fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918311:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a087fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918341:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a087ee lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e75 expref: 219 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918350:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.918352:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.918356:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a087ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e75 expref: 219 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.918366:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602dda200, rc 0) 00000100:00100000:1.0:1784938785.918428:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+218:25037:x1871643326124288:12345-192.168.202.4@tcp:101:cp.0 Request processed in 755us (1056us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938785.918435:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 224 00000100:00100000:2.0:1784938785.926307:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.926398:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326124416 00000100:00100000:0.0:1784938785.926407:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326124416 00000100:00100000:0.0:1784938785.926465:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 225 00000100:00100000:0.0:1784938785.926476:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+218:25037:x1871643326124416:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.926497:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.926519:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08803 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e7c expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926592:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0880a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926608:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0880a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926619:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0880a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926633:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926640:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926646:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926793:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0880a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926801:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0880a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926808:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0880a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926814:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938785.926819:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0880a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926826:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0880a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926838:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938785.926841:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938785.926847:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0880a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926853:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0880a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926866:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926871:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08811 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926877:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926890:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddb600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938785.926893:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926899:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08811 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926907:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe087ee79 (ffff974609f5da00) 00010000:00010000:0.0:1784938785.926909:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938785.926912:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08811 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926918:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb600/0xcd9d312a94a08811 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926952:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08803 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e7c expref: 219 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926961:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938785.926963:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938785.926967:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08803 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e7c expref: 219 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.926975:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddbe00, rc 0) 00000100:00100000:0.0:1784938785.927052:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+218:25037:x1871643326124416:12345-192.168.202.4@tcp:101:cp.0 Request processed in 578us (756us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938785.927060:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 225 00000100:00100000:3.0:1784938785.931165:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938785.931383:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326124672 00000100:00100000:1.0:1784938785.931395:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326124672 00000100:00100000:1.0:1784938785.931460:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 226 00000100:00100000:1.0:1784938785.931471:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+218:25037:x1871643326124672:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938785.931494:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938785.931517:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08818 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e83 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.931678:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0881f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.931694:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0881f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.931705:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0881f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.931720:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08826 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.931728:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08826 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.931734:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08826 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938785.932254:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24:0x0], index 0: 0 00010000:00010000:1.0:1784938785.932445:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a0882d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.932455:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a0882d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.932463:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a0882d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.932495:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0881f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.932514:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0881f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.932520:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0881f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.937467:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938785.937475:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0881f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.937488:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0881f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.937507:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938785.937510:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938785.937516:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0881f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.937524:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a0881f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938785.937545:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000acaba363 reply state 000000003513c9a6 transno 4294967438 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08826 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938785.937555:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938785.937607:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08818 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e83 expref: 221 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.937622:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a0882d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e83 expref: 220 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938785.937655:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff974702d24000) 00010000:00010000:1.0:1784938785.937658:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938785.937660:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290b000, rc 0) 00000100:00100000:1.0:1784938785.937733:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+221:25037:x1871643326124672:12345-192.168.202.4@tcp:101:cp.0 Request processed in 6263us (6577us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1784938785.937743:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 226 00010000:00010000:2.0:1784938785.944893:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08826 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.944911:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08826 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.944920:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08826 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.944926:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938785.944932:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08826 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.944940:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08826 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.944977:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xe087ee79 (ffff974702d24f00) 00010000:00010000:2.0:1784938785.944980:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938785.944985:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08826 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938785.944993:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08826 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xe087ee79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938785.954170:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.954675:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326124800 00000100:00100000:0.0:1784938785.954703:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326124800 00000100:00100000:0.0:1784938785.954813:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 148 00000100:00100000:0.0:1784938785.954824:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10024:x1871643326124800:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.954842:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.954865:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a0883b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e8a expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938785.954891:0:33065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938785.954910:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=939s v=(0 0) 00010000:00010000:0.0:1784938785.954914:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.954924:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a0883b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e8a expref: 58 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.954942:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a0883b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e8a expref: 58 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.954957:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddbe00, rc 0) 00000100:00100000:0.0:1784938785.955020:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10024:x1871643326124800:12345-192.168.202.4@tcp:101:cp.0 Request processed in 198us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938785.955028:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 148 00000100:00100000:3.0:1784938785.984613:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938785.984861:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326124928 00000100:00100000:0.0:1784938785.984872:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326124928 00000100:00100000:0.0:1784938785.984944:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 149 00000100:00100000:0.0:1784938785.984956:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:25037:x1871643326124928:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938785.984976:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938785.984996:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cda97abe/0xcd9d312a94a08842 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e91 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.985044:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a0883b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e8a expref: 59 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.985055:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.985059:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938785.985065:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda97abe/0xcd9d312a94a08842 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e91 expref: 59 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.985097:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a0883b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e8a expref: 59 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938785.985114:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a0883b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e8a expref: 59 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938785.985129:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342560128:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938785.985286:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473567b180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938786.001093:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342560128:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938786.001134:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cda97abe/0xcd9d312a94a08842 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->28671] (req 0->28671) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e91 expref: 59 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.001156:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddb600, rc 0) 00000100:00100000:0.0:1784938786.001270:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:25037:x1871643326124928:12345-192.168.202.4@tcp:101:cp.0 Request processed in 16316us (16666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938786.001287:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 149 00000100:00100000:3.0:1784938786.005685:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.006004:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326125056 00000100:00100000:1.0:1784938786.006015:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326125056 00010000:00010000:1.0:1784938786.006057:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a0883b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e8a expref: 59 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.006107:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:1.0:1784938786.006117:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:10023:x1871643326125056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938786.006132:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938786.006158:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a0883b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e8a expref: 59 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.006173:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a0883b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e8a expref: 59 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.006197:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a0883b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e8a expref: 59 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.006224:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.006251:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.006261:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cda97abe/0xcd9d312a94a08842 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e91 expref: 58 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.006270:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda97abe/0xcd9d312a94a08842 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e91 expref: 58 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.006313:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cda97abe/0xcd9d312a94a08842 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e91 expref: 58 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.006326:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342560256:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938786.006394:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1db40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938786.010136:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342560256:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938786.010166:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938786.010231:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10023:x1871643326125056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4113us (4554us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938786.010242:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:0.0:1784938786.015465:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938786.021325:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326125312 00000100:00100000:3.0:1784938786.021344:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326125312 00000100:00100000:2.0:1784938786.029491:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:2.0:1784938786.029505:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705cda850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+220:25037:x1871643326125312:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:2.0:1784938786.029900:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705cda850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+221:25037:x1871643326125312:12345-192.168.202.4@tcp:35:cp.0 Request processed in 397us (14445us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1784938786.029909:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00080000:1.0:1784938786.030023:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938786.043273:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.043557:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326125440 00000100:00100000:0.0:1784938786.043567:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326125440 00000100:00100000:0.0:1784938786.043629:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 227 00000100:00100000:0.0:1784938786.043639:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+221:25037:x1871643326125440:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938786.043665:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938786.043688:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08849 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e98 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.043798:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08850 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.043813:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08850 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.043825:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08850 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.043840:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08857 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.043847:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.043854:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.043916:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08850 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.043923:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08850 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.043945:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08850 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.043953:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbe00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.043957:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08850 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.043966:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08850 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.043978:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.043982:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.043986:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08850 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.043992:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a08850 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.044006:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.044012:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08857 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.044019:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08857 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.044024:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.044027:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08857 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.044043:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08857 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.044051:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4d2290fc (ffff974609f5db00) 00010000:00010000:0.0:1784938786.044054:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.044057:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08857 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.044064:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08857 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.044097:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08849 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e98 expref: 222 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.044107:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.044110:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.044114:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08849 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e98 expref: 222 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.044124:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddbc00, rc 0) 00000100:00100000:0.0:1784938786.044188:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+221:25037:x1871643326125440:12345-192.168.202.4@tcp:101:cp.0 Request processed in 549us (925us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938786.044195:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 227 00000100:00100000:3.0:1784938786.057409:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.058646:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326125568 00000100:00100000:0.0:1784938786.058666:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326125568 00000100:00100000:0.0:1784938786.058745:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 228 00000100:00100000:0.0:1784938786.058804:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+221:25037:x1871643326125568:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938786.058846:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938786.058870:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0885e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5e9f expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.058932:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08865 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.058947:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08865 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.058959:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08865 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.058974:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0886c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.058981:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0886c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.058988:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0886c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059053:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08865 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059061:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08865 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059068:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059075:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.059085:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059094:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08865 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059107:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.059110:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.059115:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08865 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059123:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08865 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059136:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0886c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059143:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0886c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059150:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0886c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059155:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbe00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.059158:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0886c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059164:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0886c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059170:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4d2290fc (ffff974609f5db00) 00010000:00010000:0.0:1784938786.059173:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.059183:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0886c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059189:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0886c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059231:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0885e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e9f expref: 222 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059242:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.059251:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.059257:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0885e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e9f expref: 222 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.059266:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddbc00, rc 0) 00000100:00100000:0.0:1784938786.059340:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+221:25037:x1871643326125568:12345-192.168.202.4@tcp:101:cp.0 Request processed in 539us (1947us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938786.059348:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 228 00000100:00100000:3.0:1784938786.072559:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.073154:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326125824 00000100:00100000:0.0:1784938786.073164:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326125824 00000100:00100000:0.0:1784938786.073238:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 229 00000100:00100000:0.0:1784938786.073248:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+221:25037:x1871643326125824:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938786.073270:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938786.073295:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08873 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ea6 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.073425:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0887a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.073462:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0887a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.073474:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0887a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.073490:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08881 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.073497:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.073503:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938786.073987:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24:0x0], index 1: 0 00010000:00010000:0.0:1784938786.074145:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.074156:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.074165:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.074196:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0887a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.074203:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0887a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.074221:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0887a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.074235:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbe00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.074239:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0887a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.074247:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0887a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.074260:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.074263:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.074267:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0887a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.074273:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a0887a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938786.074286:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8c85012 reply state 0000000044561ff9 transno 4294967440 ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938786.074295:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938786.074326:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a08873 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ea6 expref: 224 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.074341:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ea6 expref: 223 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.074348:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff974609f5d100) 00010000:00010000:0.0:1784938786.074350:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938786.074353:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddb800, rc 0) 00000100:00100000:0.0:1784938786.074432:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+224:25037:x1871643326125824:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1184us (1883us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1784938786.074446:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 229 00010000:00010000:2.0:1784938786.095487:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.095506:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08881 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.095514:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08881 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.095520:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.095525:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08881 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.095534:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08881 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.095571:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4d2290fc (ffff974609f5db00) 00010000:00010000:2.0:1784938786.095573:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.095579:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08881 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.095586:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08881 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4d2290fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.096086:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.096366:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326125952 00000100:00100000:0.0:1784938786.096376:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326125952 00000100:00100000:0.0:1784938786.096433:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 150 00000100:00100000:0.0:1784938786.096443:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10026:x1871643326125952:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938786.096461:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938786.096482:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2d0f114/0xcd9d312a94a08896 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ead expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938786.096507:0:33065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938786.096527:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=939s v=(0 0) 00010000:00010000:0.0:1784938786.096531:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938786.096539:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2d0f114/0xcd9d312a94a08896 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ead expref: 58 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.096557:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2d0f114/0xcd9d312a94a08896 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ead expref: 58 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.096569:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddbc00, rc 0) 00000100:00100000:0.0:1784938786.096635:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10026:x1871643326125952:12345-192.168.202.4@tcp:101:cp.0 Request processed in 193us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938786.096643:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 150 00010000:00010000:3.0:1784938786.099113:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938786.115303:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.115458:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326126080 00000100:00100000:2.0:1784938786.115468:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326126080 00000100:00100000:2.0:1784938786.115528:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 151 00000100:00100000:2.0:1784938786.115538:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:25037:x1871643326126080:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938786.115557:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938786.115577:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0889d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5eb4 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.115609:0:31428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2d0f114/0xcd9d312a94a08896 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ead expref: 59 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.115618:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938786.115623:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938786.115628:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0889d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->1179647] (req 0->1179647) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5eb4 expref: 59 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.115662:0:31428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2d0f114/0xcd9d312a94a08896 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ead expref: 59 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.116108:0:31428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2d0f114/0xcd9d312a94a08896 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ead expref: 59 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938786.116124:0:31428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746026a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342560384:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938786.116252:0:31428:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0ca840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938786.130255:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938786.130554:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326126208 00000100:00100000:3.0:1784938786.130564:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326126208 00010000:00010000:3.0:1784938786.130633:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2d0f114/0xcd9d312a94a08896 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ead expref: 60 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.130685:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:3.0:1784938786.130696:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:10025:x1871643326126208:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938786.130715:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938786.130742:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2d0f114/0xcd9d312a94a08896 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ead expref: 60 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.130811:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2d0f114/0xcd9d312a94a08896 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ead expref: 60 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.130841:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938786.130846:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938786.130857:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0889d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5eb4 expref: 60 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.130868:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0889d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5eb4 expref: 60 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.130925:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0889d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5eb4 expref: 60 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.130942:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460134fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342560512:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938786.131022:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff97474005b300 going to sleep for 11 seconds 00010000:00010000:0.0:1784938786.132596:0:31428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2d0f114/0xcd9d312a94a08896 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ead expref: 60 pid: 33065 timeout: 1039 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938786.132643:0:31428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746026a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342560384:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938786.132671:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0889d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5eb4 expref: 59 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.132686:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893800, rc 0) 00000100:00100000:0.0:1784938786.132745:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:25037:x1871643326126080:12345-192.168.202.4@tcp:101:cp.0 Request processed in 17207us (17451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938786.132790:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 151 00000100:00100000:3.0:1784938786.141801:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460134fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342560512:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938786.141846:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938786.141910:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10025:x1871643326126208:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 11215us (11704us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938786.141925:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:2.0:1784938786.199039:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.199087:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.199197:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326126592 00000100:00100000:0.0:1784938786.199208:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326126592 00000100:00100000:0.0:1784938786.199290:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:0.0:1784938786.199300:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+223:25037:x1871643326126592:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938786.199971:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+224:25037:x1871643326126592:12345-192.168.202.4@tcp:35:cp.0 Request processed in 669us (936us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1784938786.199980:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:1.0:1784938786.203643:0:31431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326126336 00000100:00100000:1.0:1784938786.203663:0:31431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326126336 00002000:00100000:1.0:1784938786.203724:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x24:0x0] (0->1048575) req@ffff9746026a3800 x1871643326126336/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:262/0 lens 488/0 e 0 to 0 dl 1784938797 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938786.203736:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746026a3800 with x1871643326126336 ext(0->1048575) 00002000:00010000:1.0:1784938786.203742:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746026a3800 00000100:00100000:1.0:1784938786.204612:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:1.0:1784938786.204625:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10023:x1871643326126336:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938786.225366:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.225825:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326126720 00000100:00100000:0.0:1784938786.225839:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326126720 00000100:00100000:0.0:1784938786.225909:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 230 00000100:00100000:0.0:1784938786.225921:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+224:25037:x1871643326126720:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938786.225955:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938786.226408:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a088a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ebb expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.226490:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.226510:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.226522:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.226535:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.226540:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.226544:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.227699:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.227712:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.227718:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.227723:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.227727:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.227735:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.232290:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.232330:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.232345:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.232356:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.235394:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.235403:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.235410:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.235414:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.235418:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.235425:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.235447:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x489b8eb2 (ffff97471a2bc800) 00010000:00010000:0.0:1784938786.235449:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.235455:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.235460:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.235539:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a088a4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ebb expref: 225 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.235581:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.235584:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.235588:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a088a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ebb expref: 225 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.235599:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddbe00, rc 0) 00000100:00100000:0.0:1784938786.235700:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+224:25037:x1871643326126720:12345-192.168.202.4@tcp:101:cp.0 Request processed in 9779us (10345us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938786.235711:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 230 00000100:00100000:3.0:1784938786.251950:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938786.252154:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326126848 00000100:00100000:3.0:1784938786.252168:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326126848 00000100:00100000:3.0:1784938786.252258:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 231 00000100:00100000:3.0:1784938786.252272:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+224:25037:x1871643326126848:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938786.252309:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938786.252339:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a088b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ec2 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.252612:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a088c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.252633:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a088c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.252647:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a088c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.252666:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a088c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.252674:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a088c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.252681:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a088c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.265849:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a088c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.265874:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a088c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.265883:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a088c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.265890:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.265895:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a088c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.265904:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a088c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.265928:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938786.265931:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.265949:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a088c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.265956:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a088c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.266880:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a088c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.266894:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a088c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.266901:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a088c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.266907:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.266911:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a088c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.266919:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a088c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.266933:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x489b8eb2 (ffff9747214ca600) 00010000:00010000:2.0:1784938786.266935:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.266939:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a088c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.266945:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a088c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.267267:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a088b9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ec2 expref: 225 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.267302:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938786.267305:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.267311:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a088b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ec2 expref: 225 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.267322:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045400, rc 0) 00000100:00100000:2.0:1784938786.281265:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+224:25037:x1871643326126848:12345-192.168.202.4@tcp:101:cp.0 Request processed in 28977us (29314us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938786.281285:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 231 00000100:00100000:1.0:1784938786.281742:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:10023:x1871643326126336:12345-192.168.202.4@tcp:4:cp.0 Request processed in 77118us (82651us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1784938786.285377:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 46 00002000:00100000:1.0:1784938786.285412:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x24:0x0] (0->1048575) req@ffff9746026a3800 x1871643326126336/t4294967329(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:262/0 lens 488/448 e 0 to 0 dl 1784938797 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938786.285426:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746026a3800 with x1871643326126336 ext(0->1048575) 00002000:00010000:1.0:1784938786.285435:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746026a3800 00000100:00100000:2.0:1784938786.298425:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.298558:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326127104 00000100:00100000:0.0:1784938786.298574:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326127104 00000100:00100000:0.0:1784938786.298658:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 232 00000100:00100000:0.0:1784938786.298671:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+224:25037:x1871643326127104:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938786.298700:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938786.298730:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a088ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ec9 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.299149:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.299170:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.299185:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.299201:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.299229:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.299236:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938786.300207:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x25:0x0], index 0: 0 00010000:00010000:0.0:1784938786.300545:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a088e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.300561:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a088e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.300573:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a088e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.300623:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.300631:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.300638:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.300646:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602dda200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.300653:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.300662:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.300690:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.300694:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.300701:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.300722:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a088d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938786.300746:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066348574 reply state 00000000ea10461a transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938786.300837:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938786.300884:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbe00/0xcd9d312a94a088ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ec9 expref: 227 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.300904:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a088e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ec9 expref: 226 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.300911:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff97471a2bc800) 00010000:00010000:0.0:1784938786.300914:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938786.300917:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741250600, rc 0) 00000100:00100000:0.0:1784938786.301033:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+227:25037:x1871643326127104:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2363us (2626us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1784938786.301043:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 232 00010000:00010000:3.0:1784938786.306380:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.306407:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.306417:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.306424:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938786.306430:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.306440:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.306462:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x489b8eb2 (ffff97471a2bc200) 00010000:00010000:3.0:1784938786.306466:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938786.306472:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.306479:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a088dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x489b8eb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938786.310927:0:30612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967440 is committed 00000100:00100000:2.0:1784938786.312105:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.312184:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326127232 00000100:00100000:0.0:1784938786.312198:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326127232 00000100:00100000:1.0:1784938786.312372:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 152 00000100:00100000:1.0:1784938786.312387:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10024:x1871643326127232:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938786.312414:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938786.312447:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a088f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ed0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938786.312490:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938786.312517:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=940s v=(0 0) 00010000:00010000:1.0:1784938786.312523:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.312535:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a088f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed0 expref: 59 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.312561:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a088f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed0 expref: 59 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.312580:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290ac00, rc 0) 00000100:00100000:1.0:1784938786.312682:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:10024:x1871643326127232:12345-192.168.202.4@tcp:101:cp.0 Request processed in 298us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938786.312689:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 152 00000100:00100000:3.0:1784938786.319724:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.319922:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326127360 00000100:00100000:0.0:1784938786.319937:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326127360 00000100:00100000:0.0:1784938786.320018:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 153 00000100:00100000:0.0:1784938786.320067:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:25037:x1871643326127360:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938786.320093:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938786.320122:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a088f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ed7 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.320176:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a088f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed0 expref: 60 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.320187:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938786.320192:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938786.320198:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a088f8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed7 expref: 60 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.320250:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a088f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed0 expref: 60 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.320267:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a088f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed0 expref: 60 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938786.320418:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342560640:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938786.320597:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460114f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938786.327721:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.327879:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326127488 00000100:00100000:1.0:1784938786.327891:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326127488 00010000:00010000:1.0:1784938786.327948:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a088f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed0 expref: 61 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.328003:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:1.0:1784938786.328016:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:10026:x1871643326127488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938786.328038:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938786.328070:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a088f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed0 expref: 61 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.328087:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a088f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed0 expref: 61 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.328122:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.328127:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.328151:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a088f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed7 expref: 61 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.328163:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a088f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed7 expref: 61 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.328224:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a088f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed7 expref: 61 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.328268:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342560768:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938786.328547:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1db40 going to sleep for 11 seconds 00010000:00010000:0.0:1784938786.329453:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a088f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed0 expref: 61 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938786.329477:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342560640:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938786.329537:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a088f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed7 expref: 60 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.329556:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974602ddbe00, rc 0) 00000100:00100000:1.0:1784938786.329894:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:25037:x1871643326127360:12345-192.168.202.4@tcp:101:cp.0 Request processed in 9845us (10182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938786.329905:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 153 00000100:00100000:1.0:1784938786.332668:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342560768:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938786.332706:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938786.332827:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:10026:x1871643326127488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4814us (5119us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938786.332842:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:3.0:1784938786.335262:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.335868:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326127744 00000100:00100000:0.0:1784938786.335883:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326127744 00000100:00100000:0.0:1784938786.336031:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:0.0:1784938786.336044:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+83:25037:x1871643326127744:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938786.336590:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+84:25037:x1871643326127744:12345-192.168.202.4@tcp:35:cp.0 Request processed in 545us (1457us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1784938786.336600:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:3.0:1784938786.343852:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.344045:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326127872 00000100:00100000:1.0:1784938786.344060:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326127872 00000100:00100000:1.0:1784938786.344150:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 233 00000100:00100000:1.0:1784938786.344162:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+84:25037:x1871643326127872:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938786.344199:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938786.344240:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a088ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ede expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344345:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08906 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344364:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344378:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344419:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a0890d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344426:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a0890d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344432:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a0890d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344522:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344532:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08906 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344539:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08906 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344546:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938786.344551:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08906 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344560:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08906 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344574:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938786.344577:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.344583:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08906 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344591:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08906 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344615:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a0890d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344622:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a0890d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344628:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a0890d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344633:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938786.344636:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a0890d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344642:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a0890d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344650:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xf2ca543e (ffff974702d24600) 00010000:00010000:1.0:1784938786.344652:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.344655:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a0890d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344660:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a0890d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344705:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a088ff lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ede expref: 85 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.344716:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938786.344719:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.344729:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a088ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ede expref: 85 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.345096:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a200, rc 0) 00000100:00100000:1.0:1784938786.345189:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+84:25037:x1871643326127872:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1027us (1351us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938786.345199:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 233 00000100:00100000:3.0:1784938786.362183:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.362549:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326128000 00000100:00100000:2.0:1784938786.362564:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326128000 00000100:00100000:2.0:1784938786.362651:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 234 00000100:00100000:2.0:1784938786.362664:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+84:25037:x1871643326128000:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938786.362697:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938786.362739:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a08914 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ee5 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.362879:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a0891b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.362898:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a0891b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.362912:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a0891b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.362954:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08922 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.362963:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.362970:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363063:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a0891b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363072:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a0891b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363080:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a0891b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363088:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.363094:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a0891b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363105:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a0891b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363119:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938786.363123:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.363128:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a0891b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363136:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a0891b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363163:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363169:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08922 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363175:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363181:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.363185:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363192:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08922 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363200:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xf2ca543e (ffff97472ff12500) 00010000:00010000:2.0:1784938786.363203:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.363207:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08922 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363224:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08922 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363272:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a08914 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ee5 expref: 85 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363284:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938786.363287:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.363298:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a08914 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ee5 expref: 85 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.363310:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893000, rc 0) 00000100:00100000:2.0:1784938786.363642:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+84:25037:x1871643326128000:12345-192.168.202.4@tcp:101:cp.0 Request processed in 979us (1470us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938786.363651:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 234 00000100:00100000:3.0:1784938786.369509:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.371521:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326128256 00000100:00100000:2.0:1784938786.371537:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326128256 00000100:00100000:2.0:1784938786.371637:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 235 00000100:00100000:2.0:1784938786.371648:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+84:25037:x1871643326128256:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938786.371676:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938786.371706:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a08929 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5eec expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.372017:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08930 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.372037:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08930 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.372052:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08930 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.372069:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08937 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.372076:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08937 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.372083:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08937 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938786.375147:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x25:0x0], index 1: 0 00010000:00010000:3.0:1784938786.375972:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045e00/0xcd9d312a94a0893e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.376000:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045e00/0xcd9d312a94a0893e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.376017:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045e00/0xcd9d312a94a0893e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.376069:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08930 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.376077:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08930 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.376085:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08930 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.376092:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938786.376097:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08930 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.376106:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08930 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.376121:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938786.376124:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938786.376130:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08930 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.376137:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08930 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938786.376172:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009793c7c2 reply state 00000000b33e4674 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08937 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.376196:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938786.376257:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a08929 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5eec expref: 87 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.376273:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045e00/0xcd9d312a94a0893e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5eec expref: 86 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.376282:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9747214cac00) 00010000:00010000:3.0:1784938786.376284:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938786.376286:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045e00, rc 0) 00000100:00100000:3.0:1784938786.376959:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326128256:12345-192.168.202.4@tcp:101:cp.0 Request processed in 5305us (7458us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1784938786.376972:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 235 00010000:00010000:2.0:1784938786.380905:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08937 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.380929:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08937 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.380937:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08937 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.380944:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.380951:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08937 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.380960:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08937 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.380981:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xf2ca543e (ffff97472ff12500) 00010000:00010000:2.0:1784938786.380985:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.380991:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08937 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.380998:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892800/0xcd9d312a94a08937 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xf2ca543e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.398437:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.406089:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326128384 00000100:00100000:1.0:1784938786.406113:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326128384 00000100:00100000:1.0:1784938786.406219:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 154 00000100:00100000:1.0:1784938786.406232:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:10025:x1871643326128384:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938786.406259:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938786.406300:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f653177/0xcd9d312a94a0894c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ef3 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938786.406336:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938786.407004:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=940s v=(0 0) 00010000:00010000:1.0:1784938786.407013:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.407027:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f653177/0xcd9d312a94a0894c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ef3 expref: 61 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.407058:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f653177/0xcd9d312a94a0894c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ef3 expref: 61 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.407075:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a200, rc 0) 00000100:00100000:1.0:1784938786.407174:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:10025:x1871643326128384:12345-192.168.202.4@tcp:101:cp.0 Request processed in 944us (8750us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938786.407229:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 154 00000100:00100000:3.0:1784938786.410551:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.410886:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326128512 00000100:00100000:2.0:1784938786.410900:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326128512 00000100:00100000:2.0:1784938786.410989:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 155 00000100:00100000:2.0:1784938786.411000:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:25037:x1871643326128512:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938786.411024:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938786.411073:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a08953 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5efa expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.411115:0:31428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f653177/0xcd9d312a94a0894c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ef3 expref: 62 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.411125:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938786.411130:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938786.411136:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a08953 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5efa expref: 62 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.411190:0:31428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f653177/0xcd9d312a94a0894c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ef3 expref: 62 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.411216:0:31428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f653177/0xcd9d312a94a0894c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ef3 expref: 62 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938786.411232:0:31428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342560896:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938786.411369:0:31428:0:(client.c:2702:ptlrpc_set_wait()) set ffff97471886c840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938786.425137:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.425203:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.426825:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326128768 00000100:00100000:1.0:1784938786.426848:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326128768 00000100:00100000:1.0:1784938786.426966:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 154 00000100:00100000:1.0:1784938786.426979:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+10:10023:x1871643326128768:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1784938786.427095:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+10:10023:x1871643326128768:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 119us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938786.427105:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 154 00000100:00100000:3.0:1784938786.428481:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326128640 00000100:00100000:3.0:1784938786.428499:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326128640 00010000:00010000:3.0:1784938786.428557:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f653177/0xcd9d312a94a0894c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ef3 expref: 63 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.428635:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:3.0:1784938786.428648:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:10024:x1871643326128640:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938786.428666:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938786.428726:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f653177/0xcd9d312a94a0894c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ef3 expref: 63 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.428746:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f653177/0xcd9d312a94a0894c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ef3 expref: 63 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.428834:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938786.428840:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938786.428851:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a08953 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5efa expref: 63 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.428863:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a08953 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5efa expref: 63 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.429134:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a08953 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5efa expref: 63 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.429153:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460134c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342561024:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938786.429810:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974737fb99c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784938786.433163:0:31428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f653177/0xcd9d312a94a0894c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ef3 expref: 63 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938786.433236:0:31428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342560896:192.168.202.4@tcp:104: 00010000:00010000:0.0:1784938786.433280:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a08953 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5efa expref: 62 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.433300:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892800, rc 0) 00000100:00100000:0.0:1784938786.433410:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:25037:x1871643326128512:12345-192.168.202.4@tcp:101:cp.0 Request processed in 22411us (22872us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938786.433422:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 155 00000100:00100000:3.0:1784938786.436043:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460134c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342561024:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938786.436082:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938786.436159:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:10024:x1871643326128640:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7513us (11037us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938786.436173:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:3.0:1784938786.441483:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.441614:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326129024 00000100:00100000:2.0:1784938786.441634:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326129024 00000100:00100000:2.0:1784938786.441917:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:2.0:1784938786.441931:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+86:25037:x1871643326129024:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:2.0:1784938786.442622:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326129024:12345-192.168.202.4@tcp:35:cp.0 Request processed in 689us (1142us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1784938786.442657:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:0.0:1784938786.461106:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.461358:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326129152 00000100:00100000:2.0:1784938786.461382:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326129152 00000100:00100000:2.0:1784938786.461464:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 236 00000100:00100000:2.0:1784938786.461477:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326129152:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938786.461514:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938786.461548:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a0895a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f01 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.461867:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08961 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.461991:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08961 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462006:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08961 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462026:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08968 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462033:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462041:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462133:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08961 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462166:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08961 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462173:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08961 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462257:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.462263:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08961 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462273:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08961 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462289:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938786.462293:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.462299:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08961 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462306:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08961 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462323:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462330:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08968 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462335:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462341:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.462352:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462359:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08968 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462543:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd06bcd9f (ffff97472ff12500) 00010000:00010000:2.0:1784938786.462546:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.462550:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08968 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.462556:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08968 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.463163:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a0895a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f01 expref: 88 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.463189:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938786.463192:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.463197:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a0895a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f01 expref: 88 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.463218:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893000, rc 0) 00000100:00100000:2.0:1784938786.463352:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326129152:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1875us (2259us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938786.463371:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 236 00000100:00100000:3.0:1784938786.473291:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.473731:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326129280 00000100:00100000:1.0:1784938786.475288:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326129280 00000100:00100000:1.0:1784938786.476954:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 237 00000100:00100000:1.0:1784938786.476980:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326129280:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938786.477014:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938786.477048:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a0896f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f08 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477143:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08976 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477161:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08976 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477176:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08976 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477215:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a0897d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477250:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a0897d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477258:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a0897d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477351:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08976 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477360:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08976 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477578:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477586:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938786.477590:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477599:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08976 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477624:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938786.477628:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.477634:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08976 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477641:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08976 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477656:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a0897d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477671:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a0897d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477677:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a0897d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477683:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938786.477686:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a0897d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477693:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a0897d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477702:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd06bcd9f (ffff974702d24700) 00010000:00010000:1.0:1784938786.477705:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.477708:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a0897d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477714:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a0897d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477798:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a0896f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f08 expref: 88 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477811:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938786.477813:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.477817:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a000/0xcd9d312a94a0896f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f08 expref: 88 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.477840:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a000, rc 0) 00000100:00100000:1.0:1784938786.477950:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326129280:12345-192.168.202.4@tcp:101:cp.0 Request processed in 981us (4673us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938786.477960:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 237 00000100:00100000:3.0:1784938786.481975:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.482109:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326129536 00000100:00100000:0.0:1784938786.482120:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326129536 00000100:00100000:0.0:1784938786.482203:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 238 00000100:00100000:0.0:1784938786.482224:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+87:25037:x1871643326129536:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938786.482261:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938786.482290:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08984 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f0f expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.482432:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0898b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.482448:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0898b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.482461:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0898b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.482477:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08992 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.482484:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.482492:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938786.482982:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x26:0x0], index 0: 0 00010000:00010000:0.0:1784938786.483159:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0e00/0xcd9d312a94a08999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.483169:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0e00/0xcd9d312a94a08999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.483177:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0e00/0xcd9d312a94a08999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.483231:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0898b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.483239:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0898b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.483244:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0898b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.483250:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974602ddbc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.483254:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0898b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.483262:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0898b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.483273:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.483276:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.483280:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0898b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.483286:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddbc00/0xcd9d312a94a0898b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938786.483301:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fa64c503 reply state 0000000060c3c704 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938786.483310:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938786.483345:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602dda200/0xcd9d312a94a08984 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f0f expref: 90 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.483371:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0e00/0xcd9d312a94a08999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f0f expref: 89 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.483378:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff97460907c800) 00010000:00010000:0.0:1784938786.483380:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938786.483382:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460b0c0e00, rc 0) 00000100:00100000:0.0:1784938786.483468:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326129536:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1245us (1507us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1784938786.483476:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 238 00010000:00010000:3.0:1784938786.489396:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.489423:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08992 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.489431:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08992 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.489438:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938786.489443:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08992 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.489452:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08992 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.489471:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd06bcd9f (ffff97471a2bc200) 00010000:00010000:3.0:1784938786.489474:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938786.489479:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08992 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.489486:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08992 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd06bcd9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.492366:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.495937:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326129664 00000100:00100000:2.0:1784938786.495952:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326129664 00000100:00100000:2.0:1784938786.496073:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 156 00000100:00100000:2.0:1784938786.496085:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:10025:x1871643326129664:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938786.496121:0:33065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938786.496144:0:33065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a089a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f16 expref: -99 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938786.496171:0:33065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938786.496190:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=940s v=(0 0) 00010000:00010000:2.0:1784938786.496195:0:33065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938786.496204:0:33065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a089a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f16 expref: 60 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.496247:0:33065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a089a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f16 expref: 60 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.496262:0:33065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893000, rc 0) 00000100:00100000:2.0:1784938786.496338:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:10025:x1871643326129664:12345-192.168.202.4@tcp:101:cp.0 Request processed in 255us (3982us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938786.496346:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 156 00000100:00100000:0.0:1784938786.517694:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.517794:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326129792 00000100:00100000:1.0:1784938786.517805:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326129792 00000100:00100000:1.0:1784938786.517862:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 157 00000100:00100000:1.0:1784938786.517872:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:25037:x1871643326129792:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938786.517891:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938786.517909:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a089ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f1d expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.517941:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a089a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f16 expref: 61 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.517951:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.517955:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.517961:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a089ae lrc: 4/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f1d expref: 61 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.517995:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a089a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f16 expref: 61 pid: 33065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.518012:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a089a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f16 expref: 61 pid: 33065 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.518053:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342561152:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938786.518140:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1d180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938786.525696:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342561152:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938786.525748:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a089ae lrc: 3/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f1d expref: 61 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.525793:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a000, rc 0) 00000100:00100000:1.0:1784938786.525896:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:25037:x1871643326129792:12345-192.168.202.4@tcp:101:cp.0 Request processed in 8024us (8210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938786.525905:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 157 00000100:00100000:0.0:1784938786.533830:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.534172:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326129920 00000100:00100000:1.0:1784938786.534183:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326129920 00010000:00010000:1.0:1784938786.534250:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a089a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f16 expref: 61 pid: 33065 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.534305:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:1.0:1784938786.534316:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:10026:x1871643326129920:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938786.534332:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938786.534360:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a089a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f16 expref: 61 pid: 33065 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.534376:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a089a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f16 expref: 61 pid: 33065 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.534424:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7902ade/0xcd9d312a94a089a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f16 expref: 61 pid: 33065 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.534439:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.534444:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.534452:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a089ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f1d expref: 60 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.534462:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a089ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f1d expref: 60 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.534501:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a089ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f1d expref: 60 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.534514:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342561280:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938786.534587:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1d180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938786.548503:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.549264:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342561280:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938786.549292:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938786.549355:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:10026:x1871643326129920:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 15041us (16146us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938786.549368:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:0.0:1784938786.549747:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326130176 00000100:00100000:0.0:1784938786.549774:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326130176 00000100:00100000:0.0:1784938786.549825:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00100000:0.0:1784938786.549834:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+89:25037:x1871643326130176:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938786.550202:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326130176:12345-192.168.202.4@tcp:35:cp.0 Request processed in 368us (1710us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1784938786.550218:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00100000:3.0:1784938786.559094:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.565929:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326130304 00000100:00100000:0.0:1784938786.565945:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326130304 00000100:00100000:0.0:1784938786.566027:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 239 00000100:00100000:0.0:1784938786.566046:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326130304:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938786.566070:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938786.566092:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a089b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f24 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566189:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566216:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566230:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566249:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566256:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566264:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566339:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566348:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566355:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566360:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.566364:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566384:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566397:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.566399:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.566405:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566410:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566425:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566431:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566437:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566442:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.566445:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566451:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566457:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x22eacdcf (ffff97460a2efb00) 00010000:00010000:0.0:1784938786.566459:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.566461:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566476:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566511:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a089b5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f24 expref: 91 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566520:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.566522:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.566526:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a089b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f24 expref: 91 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.566534:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460b0c1000, rc 0) 00000100:00100000:0.0:1784938786.566602:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326130304:12345-192.168.202.4@tcp:101:cp.0 Request processed in 567us (7517us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938786.566610:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 239 00000100:00100000:3.0:1784938786.578890:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.582588:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326130432 00000100:00100000:0.0:1784938786.582603:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326130432 00000100:00100000:0.0:1784938786.582682:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 240 00000100:00100000:0.0:1784938786.582693:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326130432:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938786.582717:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938786.582742:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a089ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f2b expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.582830:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.582846:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.582876:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.582892:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.582900:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.582908:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.582990:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.582998:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583004:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583010:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.583014:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583021:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583043:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.583047:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.583051:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583065:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1e00/0xcd9d312a94a089d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583078:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583084:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583089:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583094:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.583097:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583103:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583111:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x22eacdcf (ffff97460a2efb00) 00010000:00010000:0.0:1784938786.583113:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.583116:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583121:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a089d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583156:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a089ca lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f2b expref: 91 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583178:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.583180:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.583184:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a089ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f2b expref: 91 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.583193:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460b0c1000, rc 0) 00000100:00100000:0.0:1784938786.583279:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326130432:12345-192.168.202.4@tcp:101:cp.0 Request processed in 587us (4399us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938786.583287:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 240 00000100:00100000:2.0:1784938786.611149:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938786.611241:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326130688 00000100:00100000:3.0:1784938786.611254:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326130688 00000100:00100000:3.0:1784938786.611320:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 241 00000100:00100000:3.0:1784938786.611349:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:25037:x1871643326130688:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938786.611371:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938786.611392:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a089df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f32 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.611524:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a089e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.611538:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a089e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.611549:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a089e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.611567:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a089ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.611573:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a089ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.611579:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a089ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938786.612132:0:30632:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x26:0x0], index 1: 0 00010000:00010000:3.0:1784938786.612330:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a089f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.612342:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a089f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.612351:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a089f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.612396:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a089e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.612404:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a089e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.612410:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a089e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.612417:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938786.612421:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a089e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.612429:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a089e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.612441:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938786.612444:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938786.612448:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a089e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.612454:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a089e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938786.612467:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d251869d reply state 00000000a1cdac20 transno 4294967448 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a089ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.612476:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784938786.612511:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a089df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f32 expref: 93 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.612540:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a089f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f32 expref: 92 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.612547:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9747214ca000) 00010000:00010000:3.0:1784938786.612549:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938786.612552:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045800, rc 0) 00000100:00100000:3.0:1784938786.612621:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+93:25037:x1871643326130688:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1276us (1482us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1784938786.612630:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 241 00010000:00010000:2.0:1784938786.618866:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a089ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.618886:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a089ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.618894:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a089ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.618901:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.618928:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a089ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.618937:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a089ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.618955:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x22eacdcf (ffff9747214ca700) 00010000:00010000:2.0:1784938786.618958:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.618963:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a089ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.618969:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a089ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x22eacdcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938786.624407:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938786.624960:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326130816 00000100:00100000:3.0:1784938786.624973:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326130816 00000100:00100000:3.0:1784938786.625028:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 158 00000100:00100000:3.0:1784938786.625037:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:10024:x1871643326130816:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938786.625055:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938786.625076:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a626d81f/0xcd9d312a94a08a02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f39 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938786.625104:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938786.625122:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=940s v=(0 0) 00010000:00010000:3.0:1784938786.625127:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938786.625136:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a626d81f/0xcd9d312a94a08a02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f39 expref: 62 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.625153:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a626d81f/0xcd9d312a94a08a02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f39 expref: 62 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.625188:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742044200, rc 0) 00000100:00100000:3.0:1784938786.625255:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:10024:x1871643326130816:12345-192.168.202.4@tcp:101:cp.0 Request processed in 218us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938786.625263:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 158 00000100:00100000:3.0:1784938786.640482:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.640632:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326130944 00000100:00100000:0.0:1784938786.640642:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326130944 00000100:00100000:0.0:1784938786.640708:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 159 00000100:00100000:0.0:1784938786.640718:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:25037:x1871643326130944:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938786.640738:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938786.640795:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008df3548c/0xcd9d312a94a08a09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f40 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.640828:0:31428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a626d81f/0xcd9d312a94a08a02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f39 expref: 63 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.640837:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938786.640842:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938786.640850:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008df3548c/0xcd9d312a94a08a09 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f40 expref: 63 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.640908:0:31428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a626d81f/0xcd9d312a94a08a02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f39 expref: 63 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.640923:0:31428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a626d81f/0xcd9d312a94a08a02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f39 expref: 63 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938786.640939:0:31428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342561408:192.168.202.4@tcp:104: 00000100:00100000:0.0:1784938786.641030:0:31428:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460114f240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938786.647481:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938786.647559:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326131072 00000100:00100000:3.0:1784938786.647568:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326131072 00010000:00010000:3.0:1784938786.647610:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a626d81f/0xcd9d312a94a08a02 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f39 expref: 64 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.647656:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:3.0:1784938786.647666:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+64:10023:x1871643326131072:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938786.647682:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938786.647704:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a626d81f/0xcd9d312a94a08a02 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f39 expref: 64 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.647720:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a626d81f/0xcd9d312a94a08a02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f39 expref: 64 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.647747:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938786.647784:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938786.647794:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008df3548c/0xcd9d312a94a08a09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f40 expref: 64 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.647826:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008df3548c/0xcd9d312a94a08a09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f40 expref: 64 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.647865:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008df3548c/0xcd9d312a94a08a09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f40 expref: 64 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.647880:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a35bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342561536:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938786.647961:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974737fb99c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784938786.648904:0:31428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a626d81f/0xcd9d312a94a08a02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f39 expref: 64 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938786.648924:0:31428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342561408:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938786.648954:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008df3548c/0xcd9d312a94a08a09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f40 expref: 63 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.648967:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460b0c1e00, rc 0) 00000100:00100000:2.0:1784938786.649016:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:25037:x1871643326130944:12345-192.168.202.4@tcp:101:cp.0 Request processed in 8298us (8543us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938786.649024:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 159 00000100:00100000:3.0:1784938786.661031:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a35bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342561536:192.168.202.4@tcp:105: 00010000:00010000:3.0:1784938786.661057:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938786.661112:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:10023:x1871643326131072:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 13447us (13640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938786.661123:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:3.0:1784938786.663374:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.663540:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326131328 00000100:00100000:0.0:1784938786.663549:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326131328 00000100:00100000:0.0:1784938786.663610:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:0.0:1784938786.663620:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+92:25037:x1871643326131328:12345-192.168.202.4@tcp:35:cp.0 00000001:00080000:0.0:1784938786.663936:0:30633:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000100:00100000:0.0:1784938786.664048:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+94:25037:x1871643326131328:12345-192.168.202.4@tcp:35:cp.0 Request processed in 428us (684us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1784938786.664057:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00000020:00080000:0.0:1784938786.664062:0:30633:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784938786.688600:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.689155:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326131456 00000100:00100000:1.0:1784938786.689167:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326131456 00000100:00100000:1.0:1784938786.689243:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 242 00000100:00100000:1.0:1784938786.689276:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+94:25037:x1871643326131456:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938786.689303:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938786.689329:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08a10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f47 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689400:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08a17 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689416:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08a17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689428:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08a17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689442:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a08a1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689448:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a08a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689455:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a08a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689524:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08a17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689531:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08a17 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689538:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08a17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689554:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938786.689559:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08a17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689567:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08a17 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689581:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938786.689584:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.689590:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08a17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689596:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08a17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689610:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a08a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689616:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a08a1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689622:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a08a1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689628:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290bc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938786.689631:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a08a1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689637:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a08a1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689655:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9ce4d69c (ffff974702d24700) 00010000:00010000:1.0:1784938786.689657:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.689661:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a08a1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689667:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a08a1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689702:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08a10 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f47 expref: 95 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689712:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938786.689714:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.689718:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08a10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f47 expref: 95 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.689726:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290b800, rc 0) 00000100:00100000:1.0:1784938786.689822:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+94:25037:x1871643326131456:12345-192.168.202.4@tcp:101:cp.0 Request processed in 548us (1233us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938786.689830:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 242 00000100:00100000:3.0:1784938786.693032:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.693360:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326131584 00000100:00100000:2.0:1784938786.693372:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326131584 00000100:00100000:2.0:1784938786.693442:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 243 00000100:00100000:2.0:1784938786.693470:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+94:25037:x1871643326131584:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938786.693492:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938786.693513:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08a25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f4e expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693586:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08a2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693601:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08a2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693614:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08a2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693631:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693638:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693645:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693720:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08a2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693727:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08a2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693734:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693790:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.693796:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693805:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08a2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693818:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938786.693822:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.693828:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08a2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693845:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08a2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693862:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693868:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693874:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693879:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.693882:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693888:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693908:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9ce4d69c (ffff97472ff12d00) 00010000:00010000:2.0:1784938786.693911:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.693914:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693920:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693956:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08a25 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f4e expref: 95 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693966:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938786.693968:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.693972:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08a25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f4e expref: 95 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.693981:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893600, rc 0) 00000100:00100000:2.0:1784938786.694045:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+94:25037:x1871643326131584:12345-192.168.202.4@tcp:101:cp.0 Request processed in 577us (1022us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938786.694052:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 243 00000100:00100000:3.0:1784938786.697855:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.697995:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326131840 00000100:00100000:0.0:1784938786.698006:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326131840 00000100:00100000:0.0:1784938786.698119:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 244 00000100:00100000:0.0:1784938786.698131:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+94:25037:x1871643326131840:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1784938786.698152:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938786.698188:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08a3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f55 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.698328:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08a41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.698343:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08a41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.698356:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08a41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.698370:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08a48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.698393:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.698400:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938786.698944:0:30631:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x27:0x0], index 0: 0 00010000:00010000:0.0:1784938786.699119:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0200/0xcd9d312a94a08a4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.699130:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0200/0xcd9d312a94a08a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.699137:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0200/0xcd9d312a94a08a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.699170:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08a41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.699189:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08a41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.699195:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08a41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.699201:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.699215:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08a41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.699224:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08a41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.699237:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.699240:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.699245:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08a41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.699251:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08a41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938786.699265:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec125f03 reply state 000000009c69674d transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938786.699273:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938786.699312:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08a3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f55 expref: 97 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.699325:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0200/0xcd9d312a94a08a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f55 expref: 96 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.699344:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff97460a2efa00) 00010000:00010000:0.0:1784938786.699347:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938786.699349:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460b0c0200, rc 0) 00000100:00100000:0.0:1784938786.699431:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+97:25037:x1871643326131840:12345-192.168.202.4@tcp:101:cp.0 Request processed in 1302us (1586us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1784938786.699439:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 244 00010000:00010000:3.0:1784938786.707616:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.707635:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08a48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.707644:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08a48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.707650:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938786.707672:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08a48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.707682:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08a48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.707700:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9ce4d69c (ffff97460a2efb00) 00010000:00010000:3.0:1784938786.707703:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938786.707709:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08a48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.707716:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08a48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9ce4d69c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.710747:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.710861:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326131968 00000100:00100000:1.0:1784938786.710873:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326131968 00000100:00100000:1.0:1784938786.710948:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 160 00000100:00100000:1.0:1784938786.710959:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+60:10026:x1871643326131968:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938786.710980:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938786.711002:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a95cb0d9/0xcd9d312a94a08a5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f5c expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938786.711052:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938786.711072:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=940s v=(0 0) 00010000:00010000:1.0:1784938786.711081:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.711091:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a95cb0d9/0xcd9d312a94a08a5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f5c expref: 61 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.711108:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a95cb0d9/0xcd9d312a94a08a5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f5c expref: 61 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.711121:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290b800, rc 0) 00000100:00100000:1.0:1784938786.711179:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:10026:x1871643326131968:12345-192.168.202.4@tcp:101:cp.0 Request processed in 223us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938786.711187:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 160 00000100:00100000:0.0:1784938786.715939:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.716689:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326132096 00000100:00100000:1.0:1784938786.716702:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326132096 00000100:00100000:1.0:1784938786.716950:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 161 00000100:00100000:1.0:1784938786.716962:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:25037:x1871643326132096:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938786.716980:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938786.717001:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a08a64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f63 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.717032:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a95cb0d9/0xcd9d312a94a08a5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f5c expref: 62 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.717062:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.717067:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.717072:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a08a64 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f63 expref: 62 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.717109:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a95cb0d9/0xcd9d312a94a08a5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f5c expref: 62 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.717123:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a95cb0d9/0xcd9d312a94a08a5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f5c expref: 62 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.717138:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342561664:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938786.717243:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1d780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938786.724522:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342561664:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938786.724565:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a08a64 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f63 expref: 62 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.724592:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290bc00, rc 0) 00000100:00100000:1.0:1784938786.724662:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:25037:x1871643326132096:12345-192.168.202.4@tcp:101:cp.0 Request processed in 7702us (8732us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938786.724671:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 161 00000100:00100000:3.0:1784938786.726047:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.726191:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326132224 00000100:00100000:1.0:1784938786.726201:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326132224 00010000:00010000:1.0:1784938786.726252:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a95cb0d9/0xcd9d312a94a08a5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f5c expref: 62 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.726329:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00100000:1.0:1784938786.726339:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:10025:x1871643326132224:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938786.726354:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938786.726379:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a95cb0d9/0xcd9d312a94a08a5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f5c expref: 62 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.726394:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a95cb0d9/0xcd9d312a94a08a5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f5c expref: 62 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.726419:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a95cb0d9/0xcd9d312a94a08a5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f5c expref: 62 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.726437:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.726442:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.726450:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a08a64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f63 expref: 61 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.726461:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a08a64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f63 expref: 61 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.726497:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a08a64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f63 expref: 61 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.726512:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342561792:192.168.202.4@tcp:105: 00000100:00100000:1.0:1784938786.726603:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1d780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938786.731175:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.732302:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326132480 00000100:00100000:2.0:1784938786.732315:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326132480 00000100:00100000:2.0:1784938786.732386:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:2.0:1784938786.732397:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705cd9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+96:25037:x1871643326132480:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:2.0:1784938786.732787:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705cd9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+97:25037:x1871643326132480:12345-192.168.202.4@tcp:35:cp.0 Request processed in 391us (1620us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1784938786.732795:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:1.0:1784938786.733242:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c20e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342561792:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938786.733266:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938786.733299:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:10025:x1871643326132224:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 6961us (7258us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938786.733307:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00100000:0.0:1784938786.736438:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938786.736553:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326132608 00000100:00100000:3.0:1784938786.736564:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326132608 00000100:00100000:3.0:1784938786.736669:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 245 00000100:00100000:3.0:1784938786.736679:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+97:25037:x1871643326132608:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938786.736703:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938786.736725:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08a6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f6a expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.738967:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08a72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.738987:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08a72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.738995:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08a72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739024:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08a79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739029:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739033:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739088:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08a72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739092:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08a72 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739096:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08a72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739100:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938786.739103:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08a72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739107:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08a72 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739115:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938786.739117:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938786.739120:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08a72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739124:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08a72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739139:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739143:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08a79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739146:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739149:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938786.739151:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739154:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08a79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739158:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x6caa4986 (ffff9747214ca900) 00010000:00010000:3.0:1784938786.739159:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938786.739161:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08a79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739164:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08a79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739193:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08a6b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f6a expref: 98 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739200:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938786.739201:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938786.739221:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08a6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f6a expref: 98 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.739231:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045a00, rc 0) 00000100:00100000:3.0:1784938786.739298:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+97:25037:x1871643326132608:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2619us (2868us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938786.739307:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 245 00000100:00100000:3.0:1784938786.741685:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.741795:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326132736 00000100:00100000:1.0:1784938786.741805:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326132736 00000100:00100000:1.0:1784938786.741865:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 246 00000100:00100000:1.0:1784938786.741875:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+97:25037:x1871643326132736:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938786.741891:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938786.742041:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08a80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f71 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742113:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08a87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742124:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08a87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742132:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08a87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742141:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08a8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742146:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742149:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742218:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08a87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742225:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08a87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742232:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08a87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742237:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938786.742241:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08a87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742248:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08a87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742259:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938786.742262:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.742267:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08a87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742389:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08a87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742406:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742412:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08a8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742418:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08a8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742431:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938786.742434:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08a8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742439:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08a8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742448:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x6caa4986 (ffff974702d24300) 00010000:00010000:1.0:1784938786.742450:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.742454:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08a8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742460:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08a8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742496:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08a80 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f71 expref: 98 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742507:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938786.742509:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.742513:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08a80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f71 expref: 98 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.742522:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a600, rc 0) 00000100:00100000:1.0:1784938786.742629:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+97:25037:x1871643326132736:12345-192.168.202.4@tcp:101:cp.0 Request processed in 754us (951us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938786.742637:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 246 00000100:00100000:1.0:1784938786.754609:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.755223:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326132992 00000100:00100000:2.0:1784938786.755233:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326132992 00000100:00100000:2.0:1784938786.755302:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 247 00000100:00100000:2.0:1784938786.755312:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+97:25037:x1871643326132992:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938786.755337:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938786.755362:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08a95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f78 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.755510:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a9c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.755526:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.755538:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.755553:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08aa3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.755560:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.755567:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938786.756596:0:33061:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x27:0x0], index 1: 0 00010000:00010000:2.0:1784938786.756812:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a08aaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.756824:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a08aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.756845:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a08aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.757079:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.757088:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a9c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.757095:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.757168:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.757173:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.757180:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a9c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.757192:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938786.757195:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.757200:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a9c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.757216:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08a9c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938786.757231:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003526d188 reply state 00000000b1ae8a8d transno 4294967453 ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938786.757240:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938786.757410:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08a95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f78 expref: 100 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.757426:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a08aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f78 expref: 99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.757434:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff97472ff12400) 00010000:00010000:2.0:1784938786.757436:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938786.757438:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893000, rc 0) 00000100:00100000:2.0:1784938786.757578:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+100:25037:x1871643326132992:12345-192.168.202.4@tcp:101:cp.0 Request processed in 2266us (2976us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1784938786.757588:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 247 00010000:00010000:2.0:1784938786.759463:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.759480:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.759488:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.759495:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.759499:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.759508:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08aa3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.759524:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x6caa4986 (ffff97472ff12d00) 00010000:00010000:2.0:1784938786.759527:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.759546:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08aa3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.759554:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a08aa3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.776490:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938786.778128:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326133120 00000100:00100000:3.0:1784938786.778142:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326133120 00000100:00100000:3.0:1784938786.778219:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 162 00000100:00100000:3.0:1784938786.778239:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:10023:x1871643326133120:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938786.778258:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938786.778407:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a08ab8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f7f expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938786.778437:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938786.778460:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=940s v=(0 0) 00010000:00010000:3.0:1784938786.778465:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938786.778475:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a08ab8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f7f expref: 63 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.778493:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a08ab8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f7f expref: 63 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.778507:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045a00, rc 0) 00000100:00100000:3.0:1784938786.778583:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:10023:x1871643326133120:12345-192.168.202.4@tcp:101:cp.0 Request processed in 354us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938786.778609:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 162 00000100:00100000:0.0:1784938786.817075:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.817191:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326133248 00000100:00100000:2.0:1784938786.817212:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326133248 00000100:00100000:2.0:1784938786.817284:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 163 00000100:00100000:2.0:1784938786.817293:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:25037:x1871643326133248:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938786.817309:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938786.817326:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a08abf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f86 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.817352:0:31428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a08ab8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f7f expref: 64 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.817358:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938786.817362:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938786.817365:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a08abf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f86 expref: 64 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.817392:0:31428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a08ab8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f7f expref: 64 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.817403:0:31428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a08ab8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f7f expref: 64 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938786.817433:0:31428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342561920:192.168.202.4@tcp:104: 00000100:00100000:2.0:1784938786.817514:0:31428:0:(client.c:2702:ptlrpc_set_wait()) set ffff97471886cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938786.829698:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.829964:0:31428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31428:1871643342561920:192.168.202.4@tcp:104: 00010000:00010000:2.0:1784938786.830009:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a08abf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->319487] (req 0->319487) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f86 expref: 64 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.830032:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892600, rc 0) 00000100:00100000:2.0:1784938786.830090:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+64:25037:x1871643326133248:12345-192.168.202.4@tcp:101:cp.0 Request processed in 12798us (13029us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938786.830100:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 163 00000100:00100000:3.0:1784938786.830252:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326133376 00000100:00100000:3.0:1784938786.830259:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326133376 00010000:00010000:3.0:1784938786.830358:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a08ab8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f7f expref: 64 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.830395:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:3.0:1784938786.830405:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+64:10023:x1871643326133376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938786.830417:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938786.830439:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a08ab8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f7f expref: 64 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.830453:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a08ab8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f7f expref: 64 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.830474:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e1db4b8/0xcd9d312a94a08ab8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f7f expref: 64 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.830489:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938786.830494:0:30617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938786.830501:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a08abf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f86 expref: 63 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.830512:0:30617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a08abf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f86 expref: 63 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.830572:0:30617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a08abf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f86 expref: 63 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938786.830587:0:30617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a359880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342562048:192.168.202.4@tcp:105: 00000100:00100000:3.0:1784938786.830642:0:30617:0:(client.c:2702:ptlrpc_set_wait()) set ffff974737fb99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938786.835172:0:30617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a359880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:30617:1871643342562048:192.168.202.4@tcp:105: 00010000:00010000:0.0:1784938786.835202:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938786.835315:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:10023:x1871643326133376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 4910us (5637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938786.835327:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:0.0:1784938786.850230:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.850534:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326133632 00000100:00100000:2.0:1784938786.850546:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326133632 00000100:00100000:2.0:1784938786.850605:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:2.0:1784938786.850615:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+99:25037:x1871643326133632:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:2.0:1784938786.851232:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+100:25037:x1871643326133632:12345-192.168.202.4@tcp:35:cp.0 Request processed in 616us (1022us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1784938786.851241:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:0.0:1784938786.862604:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938786.862729:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326133760 00000100:00100000:2.0:1784938786.862741:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326133760 00000100:00100000:2.0:1784938786.863558:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 248 00000100:00100000:2.0:1784938786.863570:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+100:25037:x1871643326133760:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:2.0:1784938786.863598:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938786.863620:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08ac6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f8d expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863735:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08acd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863792:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08acd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863805:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08acd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863821:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863828:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863835:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863917:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08acd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863925:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08acd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863931:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08acd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863937:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.863941:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08acd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863960:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08acd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863972:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938786.863975:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.863979:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08acd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863985:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08acd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.863998:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.864003:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.864009:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.864014:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938786.864016:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.864023:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.864030:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x47a21a83 (ffff97472ff12d00) 00010000:00010000:2.0:1784938786.864032:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.864035:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ad4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.864052:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ad4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.864097:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08ac6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f8d expref: 101 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.864107:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938786.864110:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938786.864114:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08ac6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f8d expref: 101 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.864123:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892000, rc 0) 00000100:00100000:2.0:1784938786.864193:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+100:25037:x1871643326133760:12345-192.168.202.4@tcp:101:cp.0 Request processed in 626us (1600us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938786.864201:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 248 00000100:00100000:2.0:1784938786.868433:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938786.868608:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326133888 00000100:00100000:3.0:1784938786.868619:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326133888 00000100:00100000:3.0:1784938786.868681:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 249 00000100:00100000:3.0:1784938786.868692:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+100:25037:x1871643326133888:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938786.868714:0:30632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938786.868735:0:30632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08adb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f94 expref: -99 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.868851:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ae2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.868865:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.868877:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.868893:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ae9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.868900:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.868930:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.868998:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869005:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ae2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869012:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869017:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938786.869021:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869028:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ae2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869040:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938786.869043:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938786.869048:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ae2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869054:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ae2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869068:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869074:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869087:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869092:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938786.869094:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869100:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869109:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x47a21a83 (ffff9747214ca800) 00010000:00010000:3.0:1784938786.869111:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938786.869114:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ae9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869119:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869152:0:30632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08adb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f94 expref: 101 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869162:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938786.869164:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938786.869181:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08adb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f94 expref: 101 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.869191:0:30632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045a00, rc 0) 00000100:00100000:3.0:1784938786.870054:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+100:25037:x1871643326133888:12345-192.168.202.4@tcp:101:cp.0 Request processed in 580us (848us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938786.870077:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 249 00000100:00100000:0.0:1784938786.874962:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.875215:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326134144 00000100:00100000:1.0:1784938786.875236:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326134144 00000100:00100000:1.0:1784938786.875306:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 250 00000100:00100000:1.0:1784938786.875317:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+100:25037:x1871643326134144:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938786.875343:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938786.875367:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08af0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5f9b expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.875515:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08af7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.875530:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08af7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.875540:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08af7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.875554:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08afe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.875561:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.875568:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938786.876658:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x28:0x0], index 0: 0 00010000:00010000:1.0:1784938786.877491:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08b05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.877525:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.877535:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.877576:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08af7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.877583:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08af7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.877590:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08af7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.877595:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938786.877599:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08af7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.877607:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08af7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.877619:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938786.877622:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.877626:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08af7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.877632:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08af7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938786.877645:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4359628 reply state 00000000dba64e26 transno 4294967455 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.877661:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938786.877696:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a600/0xcd9d312a94a08af0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f9b expref: 103 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.877711:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f9b expref: 102 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.877720:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff974702d24f00) 00010000:00010000:1.0:1784938786.877722:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938786.877725:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290be00, rc 0) 00000100:00100000:1.0:1784938786.878474:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+103:25037:x1871643326134144:12345-192.168.202.4@tcp:101:cp.0 Request processed in 3154us (3518us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1784938786.878485:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 250 00010000:00010000:3.0:1784938786.883473:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.883493:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08afe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.883501:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08afe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.883507:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938786.883513:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08afe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.883523:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08afe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.883541:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x47a21a83 (ffff974702d24300) 00010000:00010000:3.0:1784938786.883545:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938786.883551:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08afe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.883558:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08afe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x47a21a83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938786.887070:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938786.887525:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326134272 00000100:00100000:3.0:1784938786.887536:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326134272 00000100:00100000:3.0:1784938786.887609:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 164 00000100:00100000:3.0:1784938786.887620:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:10026:x1871643326134272:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1784938786.887641:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938786.887680:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a08b13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5fa2 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938786.887709:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938786.887729:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=940s v=(0 0) 00010000:00010000:3.0:1784938786.887733:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938786.891873:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a08b13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa2 expref: 62 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.892493:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a08b13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa2 expref: 62 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.892511:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045a00, rc 0) 00000100:00100000:3.0:1784938786.892606:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:10026:x1871643326134272:12345-192.168.202.4@tcp:101:cp.0 Request processed in 4986us (5543us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938786.892615:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 164 00000100:00100000:0.0:1784938786.907363:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.907674:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326134400 00000100:00100000:1.0:1784938786.907684:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326134400 00000100:00100000:1.0:1784938786.907742:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 165 00000100:00100000:1.0:1784938786.907770:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:25037:x1871643326134400:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1784938786.907789:0:31427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938786.907976:0:31427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a08b1a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5fa9 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.908015:0:31427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a08b13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa2 expref: 63 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.908025:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.908029:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938786.908052:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a08b1a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa9 expref: 63 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.908088:0:31427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a08b13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa2 expref: 63 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.908103:0:31427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a08b13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa2 expref: 63 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.908118:0:31427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974601c21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342562176:192.168.202.4@tcp:104: 00000100:00100000:1.0:1784938786.908420:0:31427:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1d780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938786.913989:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938786.915001:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326134528 00000100:00100000:3.0:1784938786.915013:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326134528 00010000:00010000:2.0:1784938786.915141:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a08b13 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa2 expref: 64 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938786.915398:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:2.0:1784938786.915410:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+64:10025:x1871643326134528:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938786.915428:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938786.915454:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a08b13 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa2 expref: 64 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.915497:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a08b13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa2 expref: 64 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.915532:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938786.915536:0:30616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938786.915547:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a08b1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa9 expref: 64 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.915559:0:30616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a08b1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa9 expref: 64 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938786.915602:0:30616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a08b1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa9 expref: 64 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938786.915616:0:30616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342562304:192.168.202.4@tcp:105: 00000100:00100000:2.0:1784938786.915716:0:30616:0:(client.c:2702:ptlrpc_set_wait()) set ffff97471886c900 going to sleep for 11 seconds 00010000:00010000:1.0:1784938786.916971:0:31427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e1db4b8/0xcd9d312a94a08b13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa2 expref: 64 pid: 31425 timeout: 1040 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.916994:0:31427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974601c21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31427:1871643342562176:192.168.202.4@tcp:104: 00010000:00010000:1.0:1784938786.917022:0:31427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a08b1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa9 expref: 63 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.917035:0:31427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a600, rc 0) 00000100:00100000:1.0:1784938786.917083:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:25037:x1871643326134400:12345-192.168.202.4@tcp:101:cp.0 Request processed in 9333us (9732us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938786.917092:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 165 00000100:00100000:2.0:1784938786.923579:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.923660:0:30633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326134784 00000100:00100000:0.0:1784938786.923672:0:30633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326134784 00000100:00100000:0.0:1784938786.923735:0:30633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:0.0:1784938786.923775:0:30633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+102:25037:x1871643326134784:12345-192.168.202.4@tcp:35:cp.0 00000100:00100000:0.0:1784938786.924512:0:30633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+103:25037:x1871643326134784:12345-192.168.202.4@tcp:35:cp.0 Request processed in 765us (940us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1784938786.924521:0:30633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:1.0:1784938786.929097:0:30616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:30616:1871643342562304:192.168.202.4@tcp:105: 00010000:00010000:1.0:1784938786.929131:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938786.929909:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:10025:x1871643326134528:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 14487us (15916us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938786.929924:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:2.0:1784938786.954049:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.954378:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326135040 00000100:00100000:1.0:1784938786.954406:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326135040 00000100:00100000:1.0:1784938786.954472:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 251 00000100:00100000:1.0:1784938786.954482:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+103:25043:x1871643326135040:12345-192.168.202.4@tcp:36:mkdir.0 00010000:00010000:1.0:1784938786.954644:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08b21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.954663:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08b21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.954675:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08b21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.954691:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08b28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.954698:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.954704:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938786.956726:0:33061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x50:0x0]: returning size 512 00010000:00010000:1.0:1784938786.957099:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08b21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.957111:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08b21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.957119:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08b21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.957125:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938786.957146:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08b21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.957156:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08b21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.957175:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938786.957178:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.957185:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08b21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.957191:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08b21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938786.957356:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6e4f81c reply state 00000000f7b2d809 transno 4294967457 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.957366:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938786.957656:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+105:25043:x1871643326135040:12345-192.168.202.4@tcp:36:mkdir.0 Request processed in 3170us (3614us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1784938786.957667:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 251 00010000:00010000:0.0:1784938786.960260:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.960279:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08b28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.960295:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08b28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.960302:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.960307:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08b28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.960317:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08b28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.960339:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9ee1fb9e (ffff974702d24b00) 00010000:00010000:0.0:1784938786.960342:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.960347:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08b28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.960372:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08b28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938786.983534:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938786.983686:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326135168 00000100:00100000:0.0:1784938786.983696:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326135168 00000100:00100000:0.0:1784938786.983949:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 252 00000100:00100000:0.0:1784938786.983961:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+104:25044:x1871643326135168:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1784938786.983986:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938786.984008:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08b2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5fb0 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984074:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08b36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984088:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984099:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984114:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984120:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984127:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984273:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1a00/0xcd9d312a94a08b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984300:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1a00/0xcd9d312a94a08b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984307:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1a00/0xcd9d312a94a08b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938786.984345:0:30631:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x50:0x0]: returning size 512 00000004:00200000:0.0:1784938786.984350:0:30631:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938786.984395:0:30631:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1a00/0xcd9d312a94a08b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984408:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984416:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08b36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984423:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984430:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.984435:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984443:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08b36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984456:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938786.984459:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.984463:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08b36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984481:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984497:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984504:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984510:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984515:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938786.984518:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984524:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984532:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9ee1fb9e (ffff97460a2ef800) 00010000:00010000:0.0:1784938786.984535:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938786.984538:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984543:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x9ee1fb9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984576:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08b2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fb0 expref: 106 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984603:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1a00/0xcd9d312a94a08b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fb0 expref: 105 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938786.984611:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff97460a2ef100) 00010000:00010000:0.0:1784938786.984614:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784938786.984616:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460b0c1a00, rc 0) 00000100:00100000:0.0:1784938786.984692:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+105:25044:x1871643326135168:12345-192.168.202.4@tcp:101:touch.0 Request processed in 733us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938786.984700:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 252 00000100:00100000:2.0:1784938786.988824:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938786.989596:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326135424 00000100:00100000:1.0:1784938786.989608:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326135424 00000100:00100000:1.0:1784938786.989673:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 253 00000100:00100000:1.0:1784938786.989683:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+105:25044:x1871643326135424:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:1.0:1784938786.989705:0:30630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938786.989728:0:30630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08b4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5fb7 expref: -99 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.990243:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08b52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.990262:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08b52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.990310:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08b52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.990328:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08b59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x50:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.990336:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.990343:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938786.991138:0:30630:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x28:0x0], index 1: 0 00010000:00010000:1.0:1784938786.991446:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08b60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.991461:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.991472:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.991514:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08b52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.991521:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08b52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.991527:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08b52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.991533:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938786.991548:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08b52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.991556:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08b52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.991569:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff97460a2ef100) 00010000:00010000:1.0:1784938786.991573:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938786.991577:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08b52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.991584:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08b52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938786.991599:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ebfb0072 reply state 000000009d184e05 transno 4294967458 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938786.991610:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938786.991650:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08b4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fb7 expref: 108 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.991666:0:30630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08b60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fb7 expref: 107 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938786.991673:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff974702d24a00) 00010000:00010000:1.0:1784938786.991675:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938786.991678:0:30630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290ac00, rc 0) 00000100:00100000:1.0:1784938786.991862:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+108:25044:x1871643326135424:12345-192.168.202.4@tcp:101:touch.0 Request processed in 2178us (3048us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1784938786.991871:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 253 00010000:00010000:3.0:1784938786.998078:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.998101:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08b59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.998110:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08b59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.998117:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938786.998123:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08b59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.998151:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08b59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.998171:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x1cda55a (ffff974702d24200) 00010000:00010000:3.0:1784938786.998174:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938786.998178:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08b59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938786.998184:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08b59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938786.999895:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.000508:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326135680 00000100:00100000:0.0:1784938787.000518:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326135680 00000100:00100000:0.0:1784938787.000572:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 254 00000100:00100000:0.0:1784938787.000582:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+107:25044:x1871643326135680:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:0.0:1784938787.000649:0:33061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938787.000678:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08b60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fb7 expref: 107 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.000698:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff974702d24a00) 00010000:00010000:0.0:1784938787.000712:0:33061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938787.000808:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08b6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.000821:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08b6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.000831:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08b6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.001177:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033190fc6 reply state 00000000d5f3f946 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08b6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.001189:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.001416:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+108:25044:x1871643326135680:12345-192.168.202.4@tcp:36:touch.0 Request processed in 834us (1529us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1784938787.001424:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 254 00010000:00010000:0.0:1784938787.005156:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08b6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.005175:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08b6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.005183:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08b6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.005190:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.005195:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08b6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.005214:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08b6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.005242:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff97460a2ef800) 00010000:00010000:0.0:1784938787.005246:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.005250:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08b6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.005257:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08b6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.008311:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.009018:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326135808 00000100:00100000:0.0:1784938787.009028:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326135808 00000100:00100000:0.0:1784938787.009146:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 255 00000100:00100000:0.0:1784938787.009157:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+107:25044:x1871643326135808:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1784938787.009183:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938787.009216:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5fbe expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.009302:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fbe expref: 108 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.009318:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fbe expref: 108 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.009338:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff97460a2ef400) 00010000:00010000:0.0:1784938787.009342:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938787.009345:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460b0c1200, rc 0) 00000100:00100000:0.0:1784938787.009415:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+108:25044:x1871643326135808:12345-192.168.202.4@tcp:101:touch.0 Request processed in 260us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938787.009423:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 255 00000100:00100000:1.0:1784938787.013506:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.013600:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326135936 00000100:00100000:2.0:1784938787.013609:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326135936 00000100:00100000:2.0:1784938787.013700:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 166 00000100:00100000:2.0:1784938787.013722:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:10024:x1871643326135936:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:2.0:1784938787.014074:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+64:10024:x1871643326135936:12345-192.168.202.4@tcp:2:touch.0 Request processed in 353us (578us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1784938787.014082:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 166 00000100:00100000:3.0:1784938787.017282:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.018081:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326136192 00000100:00100000:0.0:1784938787.018091:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326136192 00000100:00100000:0.0:1784938787.018146:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:0.0:1784938787.018156:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+108:25044:x1871643326136192:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:0.0:1784938787.018637:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+109:25044:x1871643326136192:12345-192.168.202.4@tcp:35:touch.0 Request processed in 480us (1372us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1784938787.018665:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00080000:1.0:1784938787.021802:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938787.035653:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.036036:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326136448 00000100:00100000:2.0:1784938787.036047:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326136448 00000100:00100000:2.0:1784938787.036197:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 256 00000100:00100000:2.0:1784938787.036217:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+109:25045:x1871643326136448:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1784938787.036244:0:33061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938787.036279:0:33061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08b7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5fc5 expref: -99 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.036412:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08b83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.036427:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08b83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.036440:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08b83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.036454:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08b8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x50:0x0].0x45fac828 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.036461:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.036469:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938787.037733:0:33061:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x29:0x0], index 0: 0 00010000:00010000:2.0:1784938787.038498:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a08b91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.038515:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a08b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.038525:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a08b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.038562:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08b83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.038569:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08b83 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.038576:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08b83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.038581:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.038585:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08b83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.038592:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08b83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.038605:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff97460a2ef100) 00010000:00010000:2.0:1784938787.038608:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.038614:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08b83 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.038635:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08b83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.038651:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a69faa64 reply state 00000000ce5fd60e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.038660:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938787.038699:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08b7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fc5 expref: 112 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.038714:0:33061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a08b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fc5 expref: 111 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.038721:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff97472ff12800) 00010000:00010000:2.0:1784938787.038723:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938787.038725:0:33061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04600, rc 0) 00000100:00100000:2.0:1784938787.039420:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+112:25045:x1871643326136448:12345-192.168.202.4@tcp:101:dd.0 Request processed in 3211us (3774us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1784938787.039429:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 256 00010000:00010000:3.0:1784938787.042369:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.042386:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08b8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.042395:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08b8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.042401:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.042406:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08b8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.042415:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08b8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.042431:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x45fac828 (ffff97472ff12d00) 00010000:00010000:3.0:1784938787.042434:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.042454:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08b8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.042461:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08b8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x45fac828 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.054654:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.054803:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326136576 00000100:00100000:2.0:1784938787.054816:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326136576 00000100:00100000:2.0:1784938787.054902:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 167 00000100:00100000:2.0:1784938787.054914:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+62:25045:x1871643326136576:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1784938787.054937:0:31428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938787.054962:0:31428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001be8c486/0xcd9d312a94a08b9f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5fcc expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938787.055011:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938787.055033:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=940s v=(0 0) 00010000:00010000:2.0:1784938787.055038:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938787.055048:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001be8c486/0xcd9d312a94a08b9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fcc expref: 63 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.055065:0:31428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001be8c486/0xcd9d312a94a08b9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fcc expref: 63 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.055078:0:31428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04200, rc 0) 00000100:00100000:2.0:1784938787.055134:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:25045:x1871643326136576:12345-192.168.202.4@tcp:101:dd.0 Request processed in 223us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938787.055141:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 167 00000100:00080000:1.0:1784938787.055565:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938787.081003:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.081100:0:30634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326136832 00000100:00100000:2.0:1784938787.081111:0:30634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326136832 00000100:00100000:2.0:1784938787.081166:0:30634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:2.0:1784938787.081176:0:30634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+111:25045:x1871643326136832:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:2.0:1784938787.081625:0:30634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+112:25045:x1871643326136832:12345-192.168.202.4@tcp:35:dd.0 Request processed in 448us (632us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1784938787.081635:0:30634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:0.0:1784938787.086603:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938787.086809:0:33067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326136960 00000100:00100000:1.0:1784938787.086820:0:33067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326136960 00002000:00100000:1.0:1784938787.086875:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x29:0x0] (0->1048575) req@ffff974601f3df80 x1871643326136960/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:263/0 lens 488/0 e 0 to 0 dl 1784938798 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938787.086888:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601f3df80 with x1871643326136960 ext(0->1048575) 00002000:00010000:1.0:1784938787.086894:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974601f3df80 00000100:00100000:1.0:1784938787.087215:0:33067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:1.0:1784938787.087392:0:33067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+63:10023:x1871643326136960:12345-192.168.202.4@tcp:4:dd.0 00010000:00010000:3.0:1784938787.128725:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938787.156910:0:33067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+65:10023:x1871643326136960:12345-192.168.202.4@tcp:4:dd.0 Request processed in 69673us (70306us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1784938787.156928:0:33067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 47 00002000:00100000:2.0:1784938787.156943:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x29:0x0] (0->1048575) req@ffff974601f3df80 x1871643326136960/t4294967329(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:263/0 lens 488/448 e 0 to 0 dl 1784938798 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938787.156970:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974601f3df80 with x1871643326136960 ext(0->1048575) 00002000:00010000:2.0:1784938787.156978:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974601f3df80 00000100:00100000:1.0:1784938787.208218:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.208567:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326137216 00000100:00100000:3.0:1784938787.208579:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326137216 00000100:00100000:3.0:1784938787.208654:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 257 00000100:00100000:3.0:1784938787.208666:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+112:25046:x1871643326137216:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.208880:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ba6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.208911:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ba6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.208927:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ba6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.208943:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08bad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xca49d846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.208950:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xca49d846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.208957:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xca49d846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.209594:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ba6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.209604:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ba6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.209622:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ba6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.209629:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.209634:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ba6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.209642:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ba6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.209655:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.209658:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.209663:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ba6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.209670:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ba6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.209686:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000952ccf80 reply state 00000000e26c6674 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xca49d846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.209695:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.209868:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+114:25046:x1871643326137216:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1201us (1666us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1784938787.209877:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 257 00000100:00100000:0.0:1784938787.218672:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938787.218877:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326137472 00000100:00100000:1.0:1784938787.218887:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326137472 00000100:00100000:1.0:1784938787.218961:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 258 00000100:00100000:1.0:1784938787.218971:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+114:25046:x1871643326137472:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:1.0:1784938787.219124:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08bb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.219140:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08bb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.219150:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08bb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.219166:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08bbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x2cf9e95a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.219172:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08bbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2cf9e95a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.219196:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08bbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2cf9e95a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.219829:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08bb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.219839:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08bb4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.219846:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08bb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.219851:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.219855:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08bb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.219862:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08bb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.219874:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938787.219877:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.219882:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08bb4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.219888:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08bb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938787.219900:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d2a758d4 reply state 00000000a6a4dd7f transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08bbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2cf9e95a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.219909:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938787.220006:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+116:25046:x1871643326137472:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1034us (1343us total) trans 4294967464 rc 0/0 00000100:00100000:1.0:1784938787.220016:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 258 00010000:00010000:2.0:1784938787.220497:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xca49d846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.220506:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08bad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xca49d846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.220513:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08bad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xca49d846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.220519:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.220522:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08bad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xca49d846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.220529:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08bad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xca49d846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.220540:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xca49d846 (ffff9747214ca500) 00010000:00010000:2.0:1784938787.220542:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.220545:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08bad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xca49d846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.220552:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08bad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xca49d846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.224157:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08bbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2cf9e95a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.224175:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08bbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2cf9e95a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.224217:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08bbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2cf9e95a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.224230:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.224236:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08bbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2cf9e95a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.224244:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08bbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2cf9e95a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.224262:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x2cf9e95a (ffff974702d24a00) 00010000:00010000:3.0:1784938787.224273:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.224279:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08bbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2cf9e95a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.224286:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08bbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2cf9e95a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.227815:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.228175:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326137728 00000100:00100000:3.0:1784938787.228185:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326137728 00000100:00100000:3.0:1784938787.228258:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 259 00000100:00100000:3.0:1784938787.228277:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+114:25046:x1871643326137728:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.228444:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08bc2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.228463:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08bc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.228477:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08bc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.228511:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08bc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x5bff0753 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.228518:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5bff0753 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.228524:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5bff0753 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.229615:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08bc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.229626:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08bc2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.229632:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08bc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.229638:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.229643:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08bc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.229651:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08bc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.229665:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.229668:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.229673:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08bc2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.229680:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08bc2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.229707:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097fe2aa0 reply state 000000007dc29828 transno 4294967465 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5bff0753 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.229716:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.234793:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+116:25046:x1871643326137728:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 6515us (7030us total) trans 4294967465 rc 0/0 00000100:00100000:2.0:1784938787.234819:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 259 00010000:00010000:0.0:1784938787.237484:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5bff0753 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.237504:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08bc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5bff0753 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.237513:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08bc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5bff0753 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.237520:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.237525:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08bc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5bff0753 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.237533:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08bc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5bff0753 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.237550:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x5bff0753 (ffff9747214ca500) 00010000:00010000:0.0:1784938787.237554:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.237559:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08bc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5bff0753 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.237565:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08bc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5bff0753 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.239215:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.240427:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326137984 00000100:00100000:2.0:1784938787.240440:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326137984 00000100:00100000:2.0:1784938787.240511:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 260 00000100:00100000:2.0:1784938787.240521:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+115:25046:x1871643326137984:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.240698:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08bd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.240717:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.240728:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.240746:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xbf586eff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.240785:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf586eff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.240793:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf586eff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.243143:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.243161:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08bd0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.243180:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08bd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.243187:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.243217:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08bd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.244091:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08bd0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.244115:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.244118:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.244123:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08bd0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.244130:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08bd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.244146:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d2233763 reply state 000000004961f7af transno 4294967466 ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf586eff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.244155:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.244640:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+117:25046:x1871643326137984:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 4115us (5438us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1784938787.244649:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 260 00010000:00010000:3.0:1784938787.254583:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf586eff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.254602:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf586eff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.254611:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf586eff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.254618:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.254623:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf586eff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.254632:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbf586eff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.254650:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xbf586eff (ffff97472ff12e00) 00010000:00010000:3.0:1784938787.254654:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.254659:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbf586eff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.254665:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbf586eff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.265067:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.265926:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326138240 00000100:00100000:2.0:1784938787.265937:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326138240 00000100:00100000:2.0:1784938787.266000:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 261 00000100:00100000:2.0:1784938787.266011:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+116:25046:x1871643326138240:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.266157:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bde lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.266174:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.266213:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.266240:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08be5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x714abc1c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.266248:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08be5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x714abc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.266256:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08be5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x714abc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.266835:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.266844:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bde lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.266850:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.266856:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.266860:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.266867:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bde lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.266880:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.266883:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.266888:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bde lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.266900:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08bde lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.266912:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000afd5271e reply state 00000000181039de transno 4294967467 ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08be5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x714abc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.266921:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.267631:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+118:25046:x1871643326138240:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1617us (2570us total) trans 4294967467 rc 0/0 00000100:00100000:2.0:1784938787.267641:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 261 00010000:00010000:0.0:1784938787.279105:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08be5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x714abc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.279124:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08be5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x714abc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.279132:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08be5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x714abc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.279139:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.279145:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08be5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x714abc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.279152:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08be5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x714abc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.279170:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x714abc1c (ffff97472ff12f00) 00010000:00010000:0.0:1784938787.279173:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.279178:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08be5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x714abc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.279184:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08be5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x714abc1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.282254:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.282495:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326138496 00000100:00100000:0.0:1784938787.282506:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326138496 00000100:00100000:0.0:1784938787.282575:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 262 00000100:00100000:0.0:1784938787.282585:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+117:25046:x1871643326138496:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.282781:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08bec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.282799:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08bec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.282821:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08bec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.282837:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08bf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x1c1c6ea9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.282845:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1c1c6ea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.282852:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1c1c6ea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.283786:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08bec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.283797:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08bec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.283804:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08bec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.284388:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.284393:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08bec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.284402:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08bec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.284432:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.284435:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.284440:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08bec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.284446:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08bec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.284462:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054d12c28 reply state 00000000a379f572 transno 4294967468 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1c1c6ea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.284471:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.284627:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+119:25046:x1871643326138496:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 2040us (2381us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1784938787.284636:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 262 00010000:00010000:3.0:1784938787.287525:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1c1c6ea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.287561:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08bf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1c1c6ea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.287568:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1c1c6ea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.287575:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.287580:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1c1c6ea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.287588:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08bf3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1c1c6ea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.287604:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x1c1c6ea9 (ffff97460a2ef800) 00010000:00010000:3.0:1784938787.287607:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.287612:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08bf3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1c1c6ea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.287617:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08bf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1c1c6ea9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.292570:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.292869:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326138752 00000100:00100000:0.0:1784938787.292880:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326138752 00000100:00100000:0.0:1784938787.292960:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 263 00000100:00100000:0.0:1784938787.292971:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+118:25046:x1871643326138752:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.293152:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08bfa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.293171:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.293183:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.293198:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x421342a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.293225:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x421342a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.293232:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x421342a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.293831:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.293841:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08bfa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.293846:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08bfa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.293852:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.293857:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08bfa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.293864:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08bfa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.293877:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.293880:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.293885:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08bfa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.293892:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08bfa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.293905:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063354927 reply state 00000000b99d1682 transno 4294967469 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x421342a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.293923:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.294012:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+120:25046:x1871643326138752:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1041us (1450us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1784938787.294020:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 263 00010000:00010000:0.0:1784938787.297529:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x421342a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.297546:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x421342a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.297553:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x421342a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.297559:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.297564:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x421342a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.297571:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x421342a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.297587:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x421342a4 (ffff97460a2efc00) 00010000:00010000:0.0:1784938787.297590:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.297595:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x421342a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.297601:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x421342a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.304687:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938787.305391:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326139008 00000100:00100000:1.0:1784938787.305405:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326139008 00000100:00100000:1.0:1784938787.305469:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 264 00000100:00100000:1.0:1784938787.305478:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+119:25046:x1871643326139008:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:1.0:1784938787.305634:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.305650:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.305661:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.305674:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x97195 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.305681:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x97195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.305687:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x97195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.306737:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.306747:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c08 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.306783:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.306797:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.306802:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.306810:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.306825:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938787.306828:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.306833:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.306839:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938787.306852:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000076d69877 reply state 00000000b710e462 transno 4294967470 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x97195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.306861:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938787.306957:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+121:25046:x1871643326139008:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1477us (2279us total) trans 4294967470 rc 0/0 00010000:00010000:3.0:1784938787.309642:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x97195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.309659:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x97195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.309666:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x97195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.309672:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.309694:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x97195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.309702:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x97195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.309718:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x97195 (ffff974702d24200) 00010000:00010000:3.0:1784938787.309721:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.309726:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x97195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.309732:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x97195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.313234:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 264 00000100:00100000:2.0:1784938787.315845:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.316160:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326139264 00000100:00100000:0.0:1784938787.316170:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326139264 00000100:00100000:0.0:1784938787.316240:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 265 00000100:00100000:0.0:1784938787.316249:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+120:25046:x1871643326139264:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.316415:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.316433:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.316444:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.316458:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08c1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xadb41b7e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.316465:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08c1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xadb41b7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.316471:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08c1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xadb41b7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.320941:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.320956:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.323172:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.323187:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.323191:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.323413:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.323432:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.323435:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.323441:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.323447:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08c16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.323465:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000685cca99 reply state 00000000bf2ee20b transno 4294967471 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08c1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xadb41b7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.323474:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.334540:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+122:25046:x1871643326139264:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 18280us (18692us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1784938787.334554:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 265 00000100:00100000:2.0:1784938787.341166:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938787.341290:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326139520 00000100:00100000:1.0:1784938787.341300:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326139520 00000100:00100000:1.0:1784938787.341370:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 266 00000100:00100000:1.0:1784938787.341380:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+122:25046:x1871643326139520:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:1.0:1784938787.341530:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.341568:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.341581:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.341597:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xce82b4cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.341605:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xce82b4cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.341611:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xce82b4cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.342217:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.342225:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c24 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.342232:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.342237:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.342241:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.342249:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.342261:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938787.342270:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.342275:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.342281:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08c24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938787.342294:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef41ca22 reply state 00000000824a810e transno 4294967472 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xce82b4cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.342302:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938787.342385:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+124:25046:x1871643326139520:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1006us (1226us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1784938787.342393:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 266 00010000:00010000:0.0:1784938787.342929:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08c1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xadb41b7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.342940:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08c1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xadb41b7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.342946:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08c1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xadb41b7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.342951:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.342955:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08c1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xadb41b7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.342961:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08c1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xadb41b7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.342988:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xadb41b7e (ffff97460a2efc00) 00010000:00010000:0.0:1784938787.342990:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.342994:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08c1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xadb41b7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.342999:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08c1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xadb41b7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.351330:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1784938787.351545:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xce82b4cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.351558:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xce82b4cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.351566:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xce82b4cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.351572:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.351578:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xce82b4cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.351586:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xce82b4cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.351602:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xce82b4cf (ffff974702d24b00) 00010000:00010000:3.0:1784938787.351605:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.351626:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xce82b4cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.351633:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08c2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xce82b4cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.352492:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326139776 00000100:00100000:2.0:1784938787.352503:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326139776 00000100:00100000:2.0:1784938787.352569:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 267 00000100:00100000:2.0:1784938787.352579:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+122:25046:x1871643326139776:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.352724:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08c32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.352740:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08c32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.352802:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08c32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.352821:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08c39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xd7f8ca2b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.352828:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7f8ca2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.352834:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7f8ca2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.353522:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08c32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.353532:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08c32 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.353540:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08c32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.353547:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.353551:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08c32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.353559:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08c32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.353572:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.353575:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.353580:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08c32 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.353593:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08c32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.353607:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2cf9e22 reply state 00000000a90985b6 transno 4294967473 ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7f8ca2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.353617:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.353728:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+124:25046:x1871643326139776:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1148us (2405us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1784938787.353737:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 267 00010000:00010000:0.0:1784938787.355814:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7f8ca2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.355833:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08c39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7f8ca2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.355841:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08c39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7f8ca2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.355847:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.355851:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08c39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7f8ca2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.355859:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08c39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7f8ca2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.355875:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd7f8ca2b (ffff97472ff12c00) 00010000:00010000:0.0:1784938787.355879:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.355884:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08c39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd7f8ca2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.355900:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08c39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd7f8ca2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.362194:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938787.365994:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326140032 00000100:00100000:1.0:1784938787.366010:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326140032 00000100:00100000:1.0:1784938787.366120:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 268 00000100:00100000:1.0:1784938787.366130:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+123:25046:x1871643326140032:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:1.0:1784938787.367438:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c40 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.367462:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.367475:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.367490:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08c47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x5baa9714 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.367498:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5baa9714 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.367521:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5baa9714 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.368845:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.368858:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c40 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.368865:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c40 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.368871:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290ac00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.368876:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c40 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.368884:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c40 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.369349:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938787.369353:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.369360:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c40 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.369368:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c40 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938787.369387:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b3a3809 reply state 000000004befb31b transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5baa9714 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.369398:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938787.369529:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+125:25046:x1871643326140032:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 3395us (7339us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1784938787.369540:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 268 00010000:00010000:3.0:1784938787.372830:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5baa9714 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.372848:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08c47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5baa9714 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.372855:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08c47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5baa9714 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.372860:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.372865:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08c47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5baa9714 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.372872:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08c47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5baa9714 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.372888:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x5baa9714 (ffff974702d24300) 00010000:00010000:3.0:1784938787.372891:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.372911:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08c47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5baa9714 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.372917:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08c47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5baa9714 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.373039:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.380621:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326140288 00000100:00100000:2.0:1784938787.380638:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326140288 00000100:00100000:2.0:1784938787.384893:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 269 00000100:00100000:2.0:1784938787.384926:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+124:25046:x1871643326140288:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.385094:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08c4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.385114:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08c4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.385127:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08c4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.385142:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xcdc0106 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.385148:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xcdc0106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.385155:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xcdc0106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.385990:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08c4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.386000:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08c4e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.386007:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08c4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.386014:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.386018:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08c4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.386026:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08c4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.386039:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.386042:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.386046:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08c4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.386052:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08c4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.386065:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029025a0d reply state 00000000e0e5b686 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xcdc0106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.386075:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.386177:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+126:25046:x1871643326140288:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1266us (13137us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1784938787.386196:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 269 00000100:00100000:3.0:1784938787.390513:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.390551:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326140544 00000100:00100000:3.0:1784938787.390575:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326140544 00000100:00100000:3.0:1784938787.390624:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 270 00000100:00100000:3.0:1784938787.390634:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+126:25046:x1871643326140544:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.390798:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.390818:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.390831:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.390846:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xcded0dd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.390854:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xcded0dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.390860:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xcded0dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.391068:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xcdc0106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.391077:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xcdc0106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.391085:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xcdc0106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.391092:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.391097:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xcdc0106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.391105:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xcdc0106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.391119:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xcdc0106 (ffff97472ff12f00) 00010000:00010000:1.0:1784938787.391122:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.391127:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xcdc0106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.391134:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xcdc0106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.395953:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.395971:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c5c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.395978:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.395984:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.395988:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.396011:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.396030:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.396033:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.396038:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.396044:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.396061:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004926523b reply state 00000000836e588b transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xcded0dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.396069:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.396174:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+127:25046:x1871643326140544:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 5537us (5667us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1784938787.396184:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 270 00010000:00010000:3.0:1784938787.398682:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xcded0dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.398700:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xcded0dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.398707:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xcded0dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.398713:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.398717:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xcded0dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.398747:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xcded0dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.398791:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xcded0dd6 (ffff9747214ca700) 00010000:00010000:3.0:1784938787.398794:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.398799:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xcded0dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.398805:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xcded0dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.415500:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938787.415730:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326140800 00000100:00100000:1.0:1784938787.415740:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326140800 00000100:00100000:1.0:1784938787.415841:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 271 00000100:00100000:1.0:1784938787.415852:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+126:25046:x1871643326140800:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:1.0:1784938787.416061:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.416079:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.416090:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.416105:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08c71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x1f5b5cba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.416112:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08c71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f5b5cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.416119:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08c71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f5b5cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.416863:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.416874:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c6a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.416882:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.416888:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290ac00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.416892:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.416899:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.417406:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938787.417410:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.417416:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.417423:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ac00/0xcd9d312a94a08c6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938787.417437:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c70a814f reply state 00000000636dd539 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08c71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f5b5cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.417446:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.424212:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+128:25046:x1871643326140800:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 8343us (8705us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1784938787.424226:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 271 00010000:00010000:1.0:1784938787.438365:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08c71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f5b5cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.438383:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08c71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f5b5cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.438390:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08c71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f5b5cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.438396:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.438402:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08c71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f5b5cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.438410:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08c71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f5b5cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.438429:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x1f5b5cba (ffff974702d24300) 00010000:00010000:1.0:1784938787.438432:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.438457:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08c71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1f5b5cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.438465:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b800/0xcd9d312a94a08c71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1f5b5cba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.439411:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.442943:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326141056 00000100:00100000:3.0:1784938787.442959:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326141056 00000100:00100000:3.0:1784938787.443068:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 272 00000100:00100000:3.0:1784938787.443079:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+127:25046:x1871643326141056:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.443251:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.443278:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.443290:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.443307:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x2de209ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.443315:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2de209ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.443347:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2de209ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.443961:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.443971:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c78 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.443977:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.443983:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.443987:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.443995:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.444007:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.444011:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.444015:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c78 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.444022:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08c78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.444035:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae76d7ca reply state 0000000073b9835a transno 4294967478 ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2de209ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.444044:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.444154:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+129:25046:x1871643326141056:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1075us (4747us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1784938787.444162:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 272 00000100:00100000:1.0:1784938787.453063:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.453286:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326141312 00000100:00100000:2.0:1784938787.453296:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326141312 00000100:00100000:2.0:1784938787.453351:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 273 00000100:00100000:2.0:1784938787.453361:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+129:25046:x1871643326141312:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.453526:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.453544:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.453556:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.453570:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x8c52deed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.453578:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x8c52deed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.453584:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x8c52deed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.454182:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.454218:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c86 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.454225:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.454232:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.454236:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.454244:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.454256:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.454259:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.454263:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c86 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.454270:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.454284:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029af92bd reply state 00000000efa22fc5 transno 4294967479 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x8c52deed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.454292:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.454382:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+131:25046:x1871643326141312:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1021us (1327us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1784938787.454390:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 273 00010000:00010000:3.0:1784938787.454811:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2de209ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.454821:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2de209ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.454827:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2de209ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.454832:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.454835:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2de209ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.454841:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2de209ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.454852:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x2de209ee (ffff9747214ca700) 00010000:00010000:3.0:1784938787.454854:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.454858:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2de209ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.454863:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08c7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2de209ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.458474:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1784938787.458558:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x8c52deed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.458571:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x8c52deed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.458579:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x8c52deed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.458585:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.458590:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x8c52deed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.458598:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c8d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x8c52deed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.458614:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x8c52deed (ffff97472ff12e00) 00010000:00010000:0.0:1784938787.458617:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.458622:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c8d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x8c52deed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.458627:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08c8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x8c52deed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.462511:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326141568 00000100:00100000:2.0:1784938787.462528:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326141568 00000100:00100000:2.0:1784938787.462649:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 274 00000100:00100000:2.0:1784938787.462659:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974703411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+129:25046:x1871643326141568:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.463107:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.463124:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.463135:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.463149:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08c9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x4e61fd80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.463157:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e61fd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.463163:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e61fd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.464183:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.464194:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c94 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.464214:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.464221:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.464225:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.464247:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.464411:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.464415:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.464423:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.464430:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08c94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.464446:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000e06c0db reply state 000000001fddeb8b transno 4294967480 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e61fd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.464453:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.464559:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974703411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+131:25046:x1871643326141568:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1898us (6091us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1784938787.464567:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 274 00010000:00010000:3.0:1784938787.467388:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e61fd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.467405:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08c9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e61fd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.467432:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08c9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e61fd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.467439:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.467443:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08c9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e61fd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.467451:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08c9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e61fd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.467466:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4e61fd80 (ffff97472ff12100) 00010000:00010000:3.0:1784938787.467469:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.467474:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08c9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4e61fd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.467480:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08c9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4e61fd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.470244:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.470333:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326141824 00000100:00100000:2.0:1784938787.470344:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326141824 00000100:00100000:2.0:1784938787.470403:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 275 00000100:00100000:2.0:1784938787.470414:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974609ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+130:25046:x1871643326141824:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.470585:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ca2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.470604:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ca2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.470616:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ca2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.470640:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ca9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xadc4553b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.470648:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xadc4553b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.470655:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xadc4553b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.471251:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ca2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.471261:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ca2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.471269:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ca2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.471276:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.471279:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ca2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.471287:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ca2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.471299:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.471302:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.471308:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ca2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.471315:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ca2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.471335:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e386bde reply state 00000000a236e65a transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xadc4553b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.471344:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.471433:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974609ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+132:25046:x1871643326141824:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1019us (1235us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1784938787.471441:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 275 00000100:00100000:0.0:1784938787.475992:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.476049:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326142080 00000100:00100000:3.0:1784938787.476059:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326142080 00000100:00100000:3.0:1784938787.476116:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 276 00000100:00100000:3.0:1784938787.476126:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747358f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+132:25046:x1871643326142080:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.476302:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.476319:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.476330:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.476361:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08cb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x35aae202 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.476370:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x35aae202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.476377:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x35aae202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.476927:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.476937:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cb0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.476944:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.476951:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.476955:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.476963:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cb0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.476975:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.476979:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.476983:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cb0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.476989:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cb0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.477011:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099bea374 reply state 0000000018bac7fe transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x35aae202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.477019:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938787.477771:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xadc4553b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.477781:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ca9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xadc4553b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.477786:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xadc4553b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.477791:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.477794:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xadc4553b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.477800:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ca9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xadc4553b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.477811:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xadc4553b (ffff97472ff12d00) 00010000:00010000:2.0:1784938787.477813:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.477817:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ca9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xadc4553b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.477823:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08ca9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xadc4553b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.478548:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747358f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+133:25046:x1871643326142080:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 2417us (2560us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1784938787.478558:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 276 00000100:00100000:0.0:1784938787.485870:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938787.486135:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326142336 00000100:00100000:1.0:1784938787.486147:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326142336 00000100:00100000:1.0:1784938787.486216:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 277 00000100:00100000:1.0:1784938787.486236:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+133:25046:x1871643326142336:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:1.0:1784938787.486405:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cbe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.486424:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.486436:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.486452:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08cc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xa585015f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.486460:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa585015f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.486467:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa585015f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.487167:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.487183:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cbe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.487190:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.487197:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.487211:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.487221:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cbe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.487236:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938787.487239:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.487244:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cbe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.487250:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cbe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938787.487265:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f429dd4 reply state 000000003caa1e7e transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa585015f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.487274:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938787.487368:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+135:25046:x1871643326142336:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1142us (1505us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1784938787.487377:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 277 00010000:00010000:3.0:1784938787.487720:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x35aae202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.487730:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08cb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x35aae202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.487735:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08cb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x35aae202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.487740:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.487743:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08cb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x35aae202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.487782:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08cb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x35aae202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.487794:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x35aae202 (ffff9747214ca700) 00010000:00010000:3.0:1784938787.487797:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.487800:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08cb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x35aae202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.487805:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08cb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x35aae202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.491928:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa585015f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.491945:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08cc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa585015f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.491953:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa585015f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.491959:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.491964:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa585015f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.491972:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08cc5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa585015f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.491987:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa585015f (ffff974702d24300) 00010000:00010000:2.0:1784938787.491990:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.491994:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08cc5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xa585015f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.492000:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b600/0xcd9d312a94a08cc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xa585015f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.492847:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.493178:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326142592 00000100:00100000:2.0:1784938787.493188:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326142592 00000100:00100000:2.0:1784938787.493255:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 278 00000100:00100000:2.0:1784938787.493348:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+133:25046:x1871643326142592:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.493516:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ccc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.493558:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ccc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.493569:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ccc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.493586:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08cd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x5611a9ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.493593:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5611a9ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.493599:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5611a9ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.494581:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ccc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.494592:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ccc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.494600:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ccc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.494606:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.494610:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ccc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.494617:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ccc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.494630:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.494640:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.494645:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ccc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.494651:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ccc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.494665:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6aeaaba reply state 00000000e3bead6d transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5611a9ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.494673:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.494920:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472fc89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+135:25046:x1871643326142592:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1567us (2066us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1784938787.494929:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 278 00010000:00010000:3.0:1784938787.497657:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5611a9ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.497675:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08cd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5611a9ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.497682:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5611a9ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.497689:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.497694:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5611a9ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.497701:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08cd3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5611a9ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.497718:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x5611a9ad (ffff97472ff12600) 00010000:00010000:3.0:1784938787.497721:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.497726:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08cd3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5611a9ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.497733:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08cd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5611a9ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.502235:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938787.502851:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326142848 00000100:00100000:1.0:1784938787.502862:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326142848 00000100:00100000:1.0:1784938787.502956:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 279 00000100:00100000:1.0:1784938787.502976:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+134:25046:x1871643326142848:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:1.0:1784938787.503121:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cda lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.503139:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.503151:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.503167:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08ce1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x44d6c4af bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.503174:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x44d6c4af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.503180:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x44d6c4af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.504891:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cda lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.504924:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cda lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.504931:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.504937:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.504942:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cda lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.504949:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cda lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.504971:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.504974:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.504979:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cda lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.504985:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08cda lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.505000:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005863ceda reply state 0000000051cb4a7c transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x44d6c4af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.505010:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.505105:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+136:25046:x1871643326142848:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 2127us (2885us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1784938787.505113:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 279 00010000:00010000:2.0:1784938787.508065:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x44d6c4af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.508082:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08ce1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x44d6c4af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.508089:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x44d6c4af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.508095:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.508099:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x44d6c4af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.508107:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08ce1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x44d6c4af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.508122:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x44d6c4af (ffff974702d24b00) 00010000:00010000:2.0:1784938787.508125:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.508146:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08ce1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x44d6c4af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.508152:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a800/0xcd9d312a94a08ce1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x44d6c4af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.512038:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.512412:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326143104 00000100:00100000:3.0:1784938787.512424:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326143104 00000100:00100000:3.0:1784938787.512479:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 280 00000100:00100000:3.0:1784938787.512489:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+135:25046:x1871643326143104:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.512648:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ce8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.512672:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ce8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.512685:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ce8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.512702:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x860378f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.512710:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x860378f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.512717:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x860378f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.513542:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ce8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.513559:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ce8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.513566:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ce8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.513572:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.513577:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ce8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.513584:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ce8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.513599:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.513602:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.513607:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ce8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.513613:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ce8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.513628:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd9ec3f0 reply state 000000003573c34a transno 4294967486 ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x860378f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.513636:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.513835:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+137:25046:x1871643326143104:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1344us (1804us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1784938787.513844:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 280 00000100:00100000:1.0:1784938787.522555:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.522739:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326143360 00000100:00100000:0.0:1784938787.522778:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326143360 00000100:00100000:0.0:1784938787.522849:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 281 00000100:00100000:0.0:1784938787.522860:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+137:25046:x1871643326143360:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.523015:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08cf6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.523032:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08cf6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.523044:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08cf6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.523060:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08cfd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x2b6c528d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.523067:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08cfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2b6c528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.523074:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08cfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2b6c528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.523651:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08cf6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.523662:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08cf6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.523669:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08cf6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.523674:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.523678:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08cf6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.523697:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08cf6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.523711:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.523714:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.523719:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08cf6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.523725:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08cf6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.523739:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000998a8af1 reply state 00000000efe24f32 transno 4294967487 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08cfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2b6c528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.523747:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.523877:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+139:25046:x1871643326143360:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1018us (1331us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1784938787.523886:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 281 00010000:00010000:3.0:1784938787.526826:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x860378f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.526842:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x860378f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.526850:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x860378f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.526856:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.526860:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x860378f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.526869:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x860378f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.526907:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x860378f2 (ffff9747214ca700) 00010000:00010000:3.0:1784938787.526911:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.526916:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x860378f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.526923:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08cef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x860378f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.527451:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08cfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2b6c528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.527460:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08cfd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2b6c528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.527467:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08cfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2b6c528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.527472:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.527476:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08cfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2b6c528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.527482:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08cfd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2b6c528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.527493:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x2b6c528d (ffff97460a2efc00) 00010000:00010000:2.0:1784938787.527495:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.527498:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08cfd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2b6c528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.527504:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08cfd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2b6c528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.531289:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.531366:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326143616 00000100:00100000:0.0:1784938787.531376:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326143616 00000100:00100000:0.0:1784938787.531444:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 282 00000100:00100000:0.0:1784938787.531453:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+137:25046:x1871643326143616:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.531600:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.531616:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.531628:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.531660:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x4999fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.531668:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4999fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.531675:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4999fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.532425:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.532434:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d04 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.532442:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.532447:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.532452:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.532460:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.532474:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.532477:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.532481:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.532487:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.532508:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031961ac1 reply state 00000000a04b508b transno 4294967488 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4999fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.532517:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.532598:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+139:25046:x1871643326143616:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1144us (1316us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1784938787.532607:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 282 00010000:00010000:2.0:1784938787.534918:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4999fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.534952:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4999fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.534960:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4999fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.534966:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.534970:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4999fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.534978:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4999fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.534993:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4999fa (ffff97460a2efd00) 00010000:00010000:2.0:1784938787.534997:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.535001:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4999fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.535008:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4999fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.537844:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.538025:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326143872 00000100:00100000:0.0:1784938787.538036:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326143872 00000100:00100000:0.0:1784938787.538095:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 283 00000100:00100000:0.0:1784938787.538106:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746026a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+138:25046:x1871643326143872:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.538261:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.538284:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.538296:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.538311:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xdd761123 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.538319:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xdd761123 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.538325:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xdd761123 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.539259:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.539278:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d12 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.539286:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.539292:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.539297:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.539304:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.539317:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.539321:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.539325:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.539332:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.539347:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067c86fab reply state 000000001322c6ed transno 4294967489 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xdd761123 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.539355:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.539455:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746026a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+140:25046:x1871643326143872:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1348us (1618us total) trans 4294967489 rc 0/0 00000100:00100000:0.0:1784938787.539463:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 283 00010000:00010000:2.0:1784938787.541946:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xdd761123 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.541964:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xdd761123 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.541972:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xdd761123 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.541977:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.541996:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xdd761123 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.542005:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xdd761123 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.542022:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xdd761123 (ffff97460a2ef200) 00010000:00010000:2.0:1784938787.542025:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.542030:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xdd761123 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.542037:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xdd761123 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.545996:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.546168:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326144128 00000100:00100000:2.0:1784938787.546179:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326144128 00000100:00100000:2.0:1784938787.546246:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 284 00000100:00100000:2.0:1784938787.546256:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+139:25046:x1871643326144128:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.546420:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.546436:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.546448:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.546463:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x65cfa0fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.546470:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x65cfa0fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.546488:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x65cfa0fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.547601:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.547614:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d20 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.547622:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.547628:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.547633:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.547642:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.547656:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.547659:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.547664:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.547670:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.547684:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5767386 reply state 0000000070178c84 transno 4294967490 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x65cfa0fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.547693:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.548254:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+141:25046:x1871643326144128:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1994us (2263us total) trans 4294967490 rc 0/0 00000100:00100000:2.0:1784938787.548276:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 284 00010000:00010000:2.0:1784938787.551457:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x65cfa0fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.551474:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x65cfa0fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.551482:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x65cfa0fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.551488:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.551494:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x65cfa0fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.551502:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x65cfa0fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.551520:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x65cfa0fd (ffff97472ff12d00) 00010000:00010000:2.0:1784938787.551523:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.551528:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x65cfa0fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.551534:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x65cfa0fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.552731:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.553064:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326144384 00000100:00100000:2.0:1784938787.553075:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326144384 00000100:00100000:2.0:1784938787.553133:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 285 00000100:00100000:2.0:1784938787.553143:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+140:25046:x1871643326144384:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.553333:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.553350:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.553360:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.553377:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xba714f52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.553384:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xba714f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.553391:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xba714f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.553967:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.553977:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d2e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.553984:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.553991:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.553995:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.554002:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.554024:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.554027:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.554031:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.554038:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.554051:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e20b82f3 reply state 00000000e33f14c5 transno 4294967491 ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xba714f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.554061:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.554157:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+142:25046:x1871643326144384:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1014us (1433us total) trans 4294967491 rc 0/0 00000100:00100000:2.0:1784938787.554165:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 285 00010000:00010000:2.0:1784938787.556935:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xba714f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.556953:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xba714f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.556961:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xba714f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.556968:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.556972:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xba714f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.556980:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xba714f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.557016:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xba714f52 (ffff97472ff12600) 00010000:00010000:2.0:1784938787.557019:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.557024:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xba714f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.557030:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xba714f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.559380:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.559476:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326144640 00000100:00100000:0.0:1784938787.559486:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326144640 00000100:00100000:0.0:1784938787.559560:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 286 00000100:00100000:0.0:1784938787.559569:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+141:25046:x1871643326144640:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.559715:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.559731:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.559743:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.559795:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x5334a05b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.559803:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5334a05b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.559811:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5334a05b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.560407:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.560416:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d3c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.560422:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.560428:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.560432:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.560450:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.560463:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.560465:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.560470:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.560475:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.560488:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e29c8627 reply state 000000006d99bf62 transno 4294967492 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5334a05b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.560497:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.560577:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+143:25046:x1871643326144640:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1007us (1206us total) trans 4294967492 rc 0/0 00000100:00100000:0.0:1784938787.560585:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 286 00000100:00100000:1.0:1784938787.564483:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1784938787.564614:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5334a05b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.564623:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5334a05b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.564628:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5334a05b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.564632:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.564636:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5334a05b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.564641:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5334a05b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.564654:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x5334a05b (ffff97460a2efe00) 00010000:00010000:2.0:1784938787.564656:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.564660:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5334a05b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.564664:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a08d43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5334a05b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.565094:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326144896 00000100:00100000:0.0:1784938787.565103:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326144896 00000100:00100000:0.0:1784938787.565153:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 287 00000100:00100000:0.0:1784938787.565161:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+142:25046:x1871643326144896:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.565313:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.565324:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.565332:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.565349:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a08d51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xcf336fb3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.565353:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a08d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xcf336fb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.565357:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a08d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xcf336fb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.565870:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.565879:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.565885:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.565891:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.565895:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.565902:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.566258:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.566262:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.566267:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.566274:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.566300:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e212c645 reply state 00000000fb1aa4b1 transno 4294967493 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a08d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xcf336fb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.566309:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.566409:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+144:25046:x1871643326144896:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1244us (1928us total) trans 4294967493 rc 0/0 00000100:00100000:0.0:1784938787.566417:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 287 00000100:00100000:1.0:1784938787.569322:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.569554:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326145152 00000100:00100000:0.0:1784938787.569565:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326145152 00000100:00100000:0.0:1784938787.569633:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 288 00000100:00100000:0.0:1784938787.569645:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+144:25046:x1871643326145152:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.569827:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.569845:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.569857:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.569875:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x510dba2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.569883:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x510dba2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.569890:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x510dba2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.570469:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.570487:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d58 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.570495:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.570501:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.570505:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.570513:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.570526:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.570529:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.570534:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d58 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.570540:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d58 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.570555:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c43b63c reply state 0000000075531f70 transno 4294967494 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x510dba2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.570564:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.570643:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+146:25046:x1871643326145152:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 999us (1330us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1784938787.570652:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 288 00010000:00010000:2.0:1784938787.573646:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a08d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xcf336fb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.573664:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a08d51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xcf336fb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.573671:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a08d51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xcf336fb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.573678:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.573683:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a08d51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xcf336fb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.573692:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a08d51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xcf336fb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.573709:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xcf336fb3 (ffff97460a2ef300) 00010000:00010000:2.0:1784938787.573712:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.573717:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a08d51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xcf336fb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.573723:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a08d51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xcf336fb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.574152:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x510dba2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.574161:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x510dba2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.574167:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x510dba2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.574189:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.574193:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x510dba2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.574212:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x510dba2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.574231:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x510dba2c (ffff97460a2ef700) 00010000:00010000:2.0:1784938787.574234:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.574237:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d5f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x510dba2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.574244:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08d5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x510dba2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.575475:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.575702:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326145408 00000100:00100000:2.0:1784938787.575712:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326145408 00000100:00100000:2.0:1784938787.575802:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 289 00000100:00100000:2.0:1784938787.575812:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+144:25046:x1871643326145408:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.575964:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d66 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.575981:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d66 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.575992:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d66 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.576009:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x1f1e882f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.576032:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f1e882f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.576040:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f1e882f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.576638:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d66 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.576647:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d66 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.576654:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d66 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.576660:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.576664:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d66 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.576672:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d66 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.576685:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.576688:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.576693:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.576699:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08d66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.576713:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c189395e reply state 000000000fc55621 transno 4294967495 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f1e882f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.576729:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.576836:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+146:25046:x1871643326145408:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1024us (1366us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1784938787.576844:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 289 00010000:00010000:0.0:1784938787.579290:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f1e882f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.579330:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f1e882f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.579340:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f1e882f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.579346:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.579355:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f1e882f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.579364:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f1e882f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.579384:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x1f1e882f (ffff97472ff12600) 00010000:00010000:0.0:1784938787.579387:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.579392:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1f1e882f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.579399:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08d6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1f1e882f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.582376:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.582628:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326145664 00000100:00100000:0.0:1784938787.582641:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326145664 00000100:00100000:0.0:1784938787.582712:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 290 00000100:00100000:0.0:1784938787.582723:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+145:25046:x1871643326145664:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.582960:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.582980:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.583005:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.583022:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x5b2c7350 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.583028:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b2c7350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.583035:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b2c7350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.583594:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.583604:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d74 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.583611:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.583617:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.583621:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.583629:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.583641:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.583644:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.583648:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.583661:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.583675:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000038d7fa83 reply state 000000000dac6dd1 transno 4294967496 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b2c7350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.583683:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.583782:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+147:25046:x1871643326145664:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1060us (1418us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1784938787.583789:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 290 00010000:00010000:2.0:1784938787.586177:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b2c7350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.586194:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b2c7350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.586212:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b2c7350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.586219:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.586231:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b2c7350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.586240:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5b2c7350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.586256:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x5b2c7350 (ffff97460a2ef500) 00010000:00010000:2.0:1784938787.586259:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.586270:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5b2c7350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.586277:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08d7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5b2c7350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.589022:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.589139:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326145920 00000100:00100000:2.0:1784938787.589150:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326145920 00000100:00100000:2.0:1784938787.589224:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 291 00000100:00100000:2.0:1784938787.589235:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+146:25046:x1871643326145920:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.589398:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.589413:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.589425:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.589439:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x85375f57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.589447:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x85375f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.589453:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x85375f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.590011:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.590020:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d82 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.590027:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.590033:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.590038:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.590057:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.590071:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.590074:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.590080:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d82 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.590085:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08d82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.590098:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d743786 reply state 00000000c616ee29 transno 4294967497 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x85375f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.590107:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.590215:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+148:25046:x1871643326145920:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 981us (1200us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1784938787.590223:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 291 00010000:00010000:0.0:1784938787.593997:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x85375f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.594013:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x85375f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.594021:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x85375f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.594027:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.594032:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x85375f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.594040:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x85375f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.594055:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x85375f57 (ffff97472ff12d00) 00010000:00010000:0.0:1784938787.594058:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.594063:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x85375f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.594091:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08d89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x85375f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.597531:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.597719:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326146176 00000100:00100000:0.0:1784938787.597729:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326146176 00000100:00100000:0.0:1784938787.597811:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 292 00000100:00100000:0.0:1784938787.597822:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+147:25046:x1871643326146176:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.597971:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.597988:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.598001:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.598017:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x59cb6a91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.598024:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x59cb6a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.598031:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x59cb6a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.598616:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.598626:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d90 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.598645:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.598651:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.598656:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.598664:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d90 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.598678:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.598681:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.598685:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.598692:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08d90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.598706:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049d49d5a reply state 000000007e040b3e transno 4294967498 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x59cb6a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.598716:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.598833:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+149:25046:x1871643326146176:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1011us (1311us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1784938787.598841:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 292 00000100:00100000:1.0:1784938787.604211:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1784938787.604345:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x59cb6a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.604359:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x59cb6a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.604368:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x59cb6a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.604375:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.604379:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x59cb6a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.604409:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x59cb6a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.604428:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x59cb6a91 (ffff97460a2ef900) 00010000:00010000:2.0:1784938787.604431:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.604437:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x59cb6a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.604443:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08d97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x59cb6a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.604517:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326146432 00000100:00100000:0.0:1784938787.604528:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326146432 00000100:00100000:0.0:1784938787.604589:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 293 00000100:00100000:0.0:1784938787.604600:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+148:25046:x1871643326146432:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.604801:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d9e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.604816:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.604827:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.604841:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08da5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x87f34983 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.604847:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x87f34983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.604853:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x87f34983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.605413:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.605422:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d9e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.605427:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.605432:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.605435:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.605440:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d9e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.605458:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.605461:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.605465:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d9e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.605471:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08d9e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.605482:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4a2802c reply state 00000000ba6d1ccc transno 4294967499 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x87f34983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.605490:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.605568:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+150:25046:x1871643326146432:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 969us (1375us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1784938787.605577:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 293 00000100:00100000:1.0:1784938787.611002:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.611075:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326146688 00000100:00100000:3.0:1784938787.611087:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326146688 00000100:00100000:3.0:1784938787.611136:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 294 00000100:00100000:3.0:1784938787.611146:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+150:25046:x1871643326146688:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.611319:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.611337:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.611348:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.611363:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08db3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x924b5a59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.611370:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08db3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x924b5a59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.611376:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08db3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x924b5a59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.612019:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.612027:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.612034:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.612041:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.612045:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.612052:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.612067:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.612070:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.612075:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.612080:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.612095:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000683d86cb reply state 00000000a0438e11 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08db3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x924b5a59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.612104:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.612222:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+152:25046:x1871643326146688:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1076us (1226us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1784938787.612242:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 294 00000100:00100000:1.0:1784938787.616616:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938787.616656:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326146944 00000100:00100000:1.0:1784938787.616665:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326146944 00000100:00100000:1.0:1784938787.616727:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 295 00000100:00100000:1.0:1784938787.616738:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+152:25046:x1871643326146944:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:1.0:1784938787.617586:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08dba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.617605:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.617616:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.617630:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08dc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xafeab71c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.617637:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xafeab71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.617644:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xafeab71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.618069:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08db3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x924b5a59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.618078:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08db3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x924b5a59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.618084:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08db3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x924b5a59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.618090:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.618094:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08db3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x924b5a59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.618102:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08db3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x924b5a59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.618115:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x924b5a59 (ffff9747214ca700) 00010000:00010000:3.0:1784938787.618118:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.618121:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08db3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x924b5a59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.618128:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08db3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x924b5a59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.618216:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x87f34983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.618224:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08da5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x87f34983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.618336:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08da5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x87f34983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.618341:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.618345:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08da5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x87f34983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.618351:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08da5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x87f34983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.618374:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x87f34983 (ffff97460a2ef600) 00010000:00010000:0.0:1784938787.618376:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.618380:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08da5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x87f34983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.618386:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08da5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x87f34983 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.618722:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.618730:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08dba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.618745:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08dba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.619143:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.619146:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08dba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.619153:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08dba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.619163:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938787.619165:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.619169:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08dba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.619174:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a08dba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938787.619185:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a737556 reply state 000000005000b106 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xafeab71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.619194:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938787.619457:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+152:25046:x1871643326146944:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 2717us (2847us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1784938787.619467:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 295 00000100:00100000:1.0:1784938787.623318:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.623427:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326147200 00000100:00100000:3.0:1784938787.623437:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326147200 00000100:00100000:3.0:1784938787.623500:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 296 00000100:00100000:3.0:1784938787.623510:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+152:25046:x1871643326147200:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.623666:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08dc8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.623700:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08dc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.623713:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08dc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.623729:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08dcf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xc3c6a0ba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.623736:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc3c6a0ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.623743:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc3c6a0ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.624449:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08dc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.624460:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08dc8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.624466:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08dc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.624473:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.624478:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08dc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.624485:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08dc8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.624500:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.624511:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.624517:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08dc8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.624524:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08dc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.624538:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008567b530 reply state 00000000c5169fce transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc3c6a0ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.624546:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.624640:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+154:25046:x1871643326147200:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1129us (1330us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1784938787.624648:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 296 00010000:00010000:1.0:1784938787.628216:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc3c6a0ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.628242:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08dcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc3c6a0ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.628276:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08dcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc3c6a0ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.628284:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.628288:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08dcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc3c6a0ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.628296:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08dcf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc3c6a0ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.628313:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc3c6a0ba (ffff9747214ca600) 00010000:00010000:1.0:1784938787.628315:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.628320:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08dcf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc3c6a0ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.628326:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08dcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc3c6a0ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.628678:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xafeab71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.628687:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08dc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xafeab71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.628693:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xafeab71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.628699:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.628702:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xafeab71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.628709:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08dc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xafeab71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.628720:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xafeab71c (ffff974702d24200) 00010000:00010000:0.0:1784938787.628722:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.628726:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08dc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xafeab71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.628732:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a200/0xcd9d312a94a08dc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xafeab71c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.630155:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.630492:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326147456 00000100:00100000:3.0:1784938787.630504:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326147456 00000100:00100000:3.0:1784938787.630568:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 297 00000100:00100000:3.0:1784938787.630579:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+152:25046:x1871643326147456:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.630733:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dd6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.630772:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.630786:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.630802:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08ddd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xac5ff2da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.630809:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5ff2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.630833:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5ff2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.631469:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.631478:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dd6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.631484:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dd6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.631491:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.631495:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dd6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.631503:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dd6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.631517:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.631520:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.631525:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dd6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.631531:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08dd6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.631544:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b899b4b reply state 000000004fd7a73d transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5ff2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.631553:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.631899:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+154:25046:x1871643326147456:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1318us (1748us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1784938787.631907:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 297 00010000:00010000:0.0:1784938787.635005:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5ff2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.635023:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08ddd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5ff2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.635040:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08ddd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5ff2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.635046:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148a800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.635051:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08ddd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5ff2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.635058:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08ddd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5ff2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.635076:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xac5ff2da (ffff9747214caa00) 00010000:00010000:0.0:1784938787.635078:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.635084:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08ddd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xac5ff2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.635090:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148a800/0xcd9d312a94a08ddd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xac5ff2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.638224:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.638464:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326147712 00000100:00100000:3.0:1784938787.638475:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326147712 00000100:00100000:3.0:1784938787.638529:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 298 00000100:00100000:3.0:1784938787.638539:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+153:25046:x1871643326147712:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.638685:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08de4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.638703:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08de4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.638715:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08de4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.638731:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08deb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x7dac02ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.638739:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7dac02ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.638745:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7dac02ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.639415:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08de4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.639424:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08de4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.639431:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08de4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.639445:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.639450:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08de4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.639458:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08de4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.639471:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.639474:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.639479:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08de4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.639485:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08de4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.639500:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab433beb reply state 00000000c45bf1da transno 4294967504 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7dac02ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.639509:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.639604:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+155:25046:x1871643326147712:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1065us (1388us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1784938787.639612:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 298 00010000:00010000:1.0:1784938787.643234:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7dac02ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.643253:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08deb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7dac02ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.643261:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08deb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7dac02ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.643275:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.643295:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08deb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7dac02ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.643304:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08deb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7dac02ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.643320:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x7dac02ae (ffff9747214ca700) 00010000:00010000:1.0:1784938787.643324:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.643328:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08deb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x7dac02ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.643335:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08deb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x7dac02ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.645171:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.645251:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326147968 00000100:00100000:3.0:1784938787.645263:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326147968 00000100:00100000:3.0:1784938787.645329:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 299 00000100:00100000:3.0:1784938787.645340:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+154:25046:x1871643326147968:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.645511:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08df2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.645549:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08df2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.645561:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08df2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.645578:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08df9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xc6bba65a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.645585:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc6bba65a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.645592:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc6bba65a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.646215:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08df2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.646225:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08df2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.646231:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08df2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.646236:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.646241:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08df2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.646248:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08df2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.646261:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.646273:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.646278:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08df2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.646284:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08df2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.646298:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005b4602e reply state 00000000aa564f16 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc6bba65a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.646306:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.646393:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+156:25046:x1871643326147968:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1052us (1228us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1784938787.646401:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 299 00010000:00010000:0.0:1784938787.648559:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc6bba65a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.648577:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08df9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc6bba65a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.648585:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08df9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc6bba65a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.648605:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.648610:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08df9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc6bba65a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.648618:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08df9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc6bba65a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.648632:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc6bba65a (ffff9747214ca600) 00010000:00010000:0.0:1784938787.648635:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.648639:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08df9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc6bba65a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.648647:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08df9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc6bba65a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.650995:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.651182:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326148224 00000100:00100000:3.0:1784938787.651192:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326148224 00000100:00100000:3.0:1784938787.651277:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 300 00000100:00100000:3.0:1784938787.651287:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+155:25046:x1871643326148224:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.651437:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.651454:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.651466:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.651481:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xb75833e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.651487:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xb75833e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.651511:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xb75833e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.652111:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.652120:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e00 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.652126:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.652131:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.652136:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.652143:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.652156:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.652159:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.652163:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.652169:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.652183:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000041fe0e05 reply state 00000000bb8012ba transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xb75833e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.652192:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.652539:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+157:25046:x1871643326148224:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1249us (1548us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1784938787.652549:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 300 00000100:00100000:2.0:1784938787.657000:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.657076:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326148480 00000100:00100000:3.0:1784938787.657087:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326148480 00000100:00100000:3.0:1784938787.657149:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 301 00000100:00100000:3.0:1784938787.657159:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+157:25046:x1871643326148480:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.657323:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.657342:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.657353:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.657370:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x3a7cc79e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.657377:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x3a7cc79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.657384:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x3a7cc79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.657986:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.657995:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.658002:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.658016:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.658021:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.658032:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.658044:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.658046:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.658051:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.658057:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.658070:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003188a7fb reply state 00000000847a4a03 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x3a7cc79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.658079:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.658157:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+159:25046:x1871643326148480:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 998us (1166us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1784938787.658165:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 301 00010000:00010000:1.0:1784938787.658460:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xb75833e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.658469:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xb75833e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.658475:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xb75833e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.658480:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.658484:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xb75833e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.658489:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xb75833e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.658511:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xb75833e4 (ffff9747214ca500) 00010000:00010000:1.0:1784938787.658513:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.658516:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xb75833e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.658522:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xb75833e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.661928:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1784938787.662012:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x3a7cc79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.662024:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x3a7cc79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.662031:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x3a7cc79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.662038:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.662042:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x3a7cc79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.662050:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x3a7cc79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.662083:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x3a7cc79e (ffff9747214ca600) 00010000:00010000:0.0:1784938787.662086:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.662091:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x3a7cc79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.662097:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x3a7cc79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.662339:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326148736 00000100:00100000:2.0:1784938787.662350:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326148736 00000100:00100000:2.0:1784938787.662400:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 302 00000100:00100000:2.0:1784938787.662411:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+157:25046:x1871643326148736:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.662549:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08e1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.662563:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.662573:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.662590:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08e23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xad0864ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.662596:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xad0864ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.662616:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xad0864ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.663185:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.663193:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08e1c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.663212:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08e1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.663218:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.663222:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08e1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.663229:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08e1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.663240:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.663243:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.663247:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08e1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.663253:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08e1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.663265:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000022c6e6ae reply state 00000000616d97c9 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xad0864ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.663274:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.663371:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+159:25046:x1871643326148736:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 961us (1450us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1784938787.663379:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 302 00010000:00010000:3.0:1784938787.666099:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xad0864ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.666118:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08e23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xad0864ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.666126:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xad0864ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.666156:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.666161:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xad0864ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.666170:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08e23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xad0864ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.666188:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xad0864ed (ffff97472ff12100) 00010000:00010000:3.0:1784938787.666191:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.666196:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08e23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xad0864ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.666215:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08e23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xad0864ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.672831:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.672983:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326148992 00000100:00100000:3.0:1784938787.672994:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326148992 00000100:00100000:3.0:1784938787.673054:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 303 00000100:00100000:3.0:1784938787.673064:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+158:25046:x1871643326148992:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.673257:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.673280:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.673292:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.673307:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x82f7fc2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.673322:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x82f7fc2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.673331:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x82f7fc2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.677587:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.677605:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.677615:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.677622:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.677627:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.677636:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.677656:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.677659:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.677664:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.677670:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.677686:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000293b6e4 reply state 000000009f70376c transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x82f7fc2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.677710:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.677836:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+160:25046:x1871643326148992:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 4769us (5011us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1784938787.677845:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 303 00000100:00100000:1.0:1784938787.682323:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.682405:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326149248 00000100:00100000:3.0:1784938787.682415:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326149248 00000100:00100000:3.0:1784938787.682479:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 304 00000100:00100000:3.0:1784938787.682489:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+160:25046:x1871643326149248:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.682637:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.682654:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.682666:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.682680:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x91c0ae07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.682687:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x91c0ae07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.682695:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x91c0ae07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.683309:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.683319:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e38 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.683335:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.683342:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.683347:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.683355:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.683371:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.683375:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.683380:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e38 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.683387:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.683402:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002426ba02 reply state 00000000b7899255 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x91c0ae07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.683412:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.683498:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+162:25046:x1871643326149248:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1009us (1183us total) trans 4294967510 rc 0/0 00000100:00100000:3.0:1784938787.683507:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 304 00010000:00010000:0.0:1784938787.683689:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x82f7fc2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.683698:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x82f7fc2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.683703:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x82f7fc2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.683708:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.683711:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x82f7fc2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.683717:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x82f7fc2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.683728:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x82f7fc2c (ffff9747214ca700) 00010000:00010000:0.0:1784938787.683731:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.683734:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x82f7fc2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.683741:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x82f7fc2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.691429:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x91c0ae07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.691449:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x91c0ae07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.691478:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x91c0ae07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.691485:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.691489:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x91c0ae07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.691498:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x91c0ae07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.691514:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x91c0ae07 (ffff9747214caa00) 00010000:00010000:3.0:1784938787.691518:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.691523:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x91c0ae07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.691530:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x91c0ae07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.692058:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.692126:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326149504 00000100:00100000:3.0:1784938787.692135:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326149504 00000100:00100000:3.0:1784938787.692189:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 305 00000100:00100000:3.0:1784938787.692208:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+160:25046:x1871643326149504:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.692350:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.692366:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.692377:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.692402:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x8b91822a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.692410:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x8b91822a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.692417:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x8b91822a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.693052:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.693060:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e46 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.693067:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.693074:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.693077:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.693085:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.693096:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.693099:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.693103:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e46 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.693110:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.693129:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005d222343 reply state 00000000dd265441 transno 4294967511 ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x8b91822a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.693137:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.693229:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+162:25046:x1871643326149504:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1029us (1174us total) trans 4294967511 rc 0/0 00000100:00100000:3.0:1784938787.693237:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 305 00010000:00010000:0.0:1784938787.695357:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x8b91822a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.695374:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x8b91822a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.695382:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x8b91822a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.695387:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.695392:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x8b91822a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.695400:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x8b91822a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.695416:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x8b91822a (ffff9747214ca700) 00010000:00010000:0.0:1784938787.695419:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.695423:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x8b91822a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.695429:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x8b91822a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.697636:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.697905:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326149760 00000100:00100000:3.0:1784938787.697926:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326149760 00000100:00100000:3.0:1784938787.697984:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 306 00000100:00100000:3.0:1784938787.697994:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+161:25046:x1871643326149760:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.698136:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e54 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.698153:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.698164:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.698182:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08e5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x2c1ad0bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.698188:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08e5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2c1ad0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.698194:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08e5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2c1ad0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.698804:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.698820:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e54 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.698827:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.698833:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.698837:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.698844:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.698856:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.698859:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.698863:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.698870:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.698884:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004c14a3f4 reply state 00000000b981ad79 transno 4294967512 ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08e5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2c1ad0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.698892:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.698981:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+163:25046:x1871643326149760:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 987us (1353us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1784938787.698989:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 306 00010000:00010000:3.0:1784938787.703063:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08e5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2c1ad0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.703095:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08e5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2c1ad0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.703102:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08e5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2c1ad0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.703108:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974700030600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.703113:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08e5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2c1ad0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.703121:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08e5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2c1ad0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.703138:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x2c1ad0bd (ffff9747214ca600) 00010000:00010000:3.0:1784938787.703142:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.703146:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08e5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2c1ad0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.703153:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700030600/0xcd9d312a94a08e5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2c1ad0bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.705118:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.705437:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326150016 00000100:00100000:3.0:1784938787.705448:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326150016 00000100:00100000:3.0:1784938787.705505:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 307 00000100:00100000:3.0:1784938787.705516:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+162:25046:x1871643326150016:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.705669:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.705685:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.705712:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.705729:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x26fe9366 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.705736:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x26fe9366 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.705743:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x26fe9366 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.706632:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.706642:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.706649:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.706656:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.706660:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.706668:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.706681:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.706684:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.706689:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.706703:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08e62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.706717:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4c1258b reply state 000000008e9fea31 transno 4294967513 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x26fe9366 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.706726:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.707062:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+164:25046:x1871643326150016:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1544us (1950us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1784938787.707071:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 307 00000100:00100000:1.0:1784938787.710821:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.710930:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326150272 00000100:00100000:3.0:1784938787.710941:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326150272 00000100:00100000:3.0:1784938787.710990:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 308 00000100:00100000:3.0:1784938787.711000:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+164:25046:x1871643326150272:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.711144:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e70 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.711160:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.711173:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.711187:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xbef61e4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.711193:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbef61e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.711212:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbef61e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.711806:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.711823:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e70 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.711831:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.711837:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.711842:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.711850:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e70 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.711863:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.711866:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.711871:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.711876:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.711889:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f52d3c2f reply state 000000005adc630c transno 4294967514 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbef61e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.711898:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.711984:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+166:25046:x1871643326150272:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 983us (1172us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1784938787.711991:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 308 00010000:00010000:0.0:1784938787.712852:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x26fe9366 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.712862:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x26fe9366 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.712869:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x26fe9366 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.712885:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.712888:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x26fe9366 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.712895:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x26fe9366 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.712923:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x26fe9366 (ffff9747214caa00) 00010000:00010000:0.0:1784938787.712925:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.712929:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x26fe9366 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.712935:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08e69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x26fe9366 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.715096:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbef61e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.715129:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbef61e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.715136:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbef61e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.715142:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.715146:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbef61e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.715153:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbef61e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.715166:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xbef61e4f (ffff9747214ca500) 00010000:00010000:3.0:1784938787.715169:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.715173:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbef61e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.715178:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbef61e4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.717632:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.718133:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326150528 00000100:00100000:0.0:1784938787.718144:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326150528 00000100:00100000:0.0:1784938787.718219:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 309 00000100:00100000:0.0:1784938787.718229:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+164:25046:x1871643326150528:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.718404:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.718422:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.718435:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.718450:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08e85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xbff5c7a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.718475:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbff5c7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.718482:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbff5c7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.719096:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.719106:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e7e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.719114:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.719121:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.719125:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.719133:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.719146:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.719149:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.719154:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e7e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.719161:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.719175:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056f2a1b2 reply state 00000000e5ca0a85 transno 4294967515 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbff5c7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.719190:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.719302:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+166:25046:x1871643326150528:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1072us (1678us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1784938787.719311:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 309 00010000:00010000:1.0:1784938787.723701:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbff5c7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.723718:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08e85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbff5c7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.723725:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08e85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbff5c7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.723730:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.723736:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08e85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbff5c7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.723743:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08e85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbff5c7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.724011:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xbff5c7a4 (ffff97460a2ef600) 00010000:00010000:1.0:1784938787.724014:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.724019:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08e85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbff5c7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.724025:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08e85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbff5c7a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.724822:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.725468:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326150784 00000100:00100000:3.0:1784938787.725479:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326150784 00000100:00100000:3.0:1784938787.725535:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 310 00000100:00100000:3.0:1784938787.725544:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+165:25046:x1871643326150784:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.725682:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.725698:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.725725:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.725741:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x1f9d19fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.725852:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f9d19fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.725862:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f9d19fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.726746:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.728421:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e8c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.728430:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.728436:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.728441:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.728450:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.728469:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.728473:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.728478:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.728505:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08e8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.728526:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000008cc897a reply state 0000000007c99376 transno 4294967516 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f9d19fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.728535:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.728709:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+167:25046:x1871643326150784:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 3161us (3888us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1784938787.728718:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 310 00010000:00010000:3.0:1784938787.732686:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f9d19fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.732705:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f9d19fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.732713:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f9d19fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.732719:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.732724:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f9d19fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.732732:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1f9d19fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.732788:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x1f9d19fd (ffff9747214ca500) 00010000:00010000:3.0:1784938787.732792:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.732797:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1f9d19fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.732826:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08e93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1f9d19fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.733875:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.734239:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326151040 00000100:00100000:0.0:1784938787.734249:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326151040 00000100:00100000:0.0:1784938787.734308:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 311 00000100:00100000:0.0:1784938787.734317:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+166:25046:x1871643326151040:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.734479:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e9a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.734496:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e9a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.734509:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e9a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.734525:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08ea1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xd7a3b6e2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.734532:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7a3b6e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.734539:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7a3b6e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.735479:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e9a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.735490:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e9a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.735506:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e9a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.735513:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.735518:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e9a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.735526:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e9a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.735539:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.735542:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.735547:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e9a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.735554:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08e9a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.735569:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dabace36 reply state 00000000ca4534e8 transno 4294967517 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7a3b6e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.735579:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.735677:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+168:25046:x1871643326151040:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1358us (1806us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1784938787.735686:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 311 00010000:00010000:1.0:1784938787.742565:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7a3b6e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.742583:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08ea1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7a3b6e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.742591:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08ea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7a3b6e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.742597:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.742602:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08ea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7a3b6e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.742611:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08ea1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd7a3b6e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.742628:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd7a3b6e2 (ffff97460a2eff00) 00010000:00010000:1.0:1784938787.742631:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.742636:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08ea1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd7a3b6e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.742662:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08ea1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd7a3b6e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.749877:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.750122:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326151296 00000100:00100000:0.0:1784938787.750134:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326151296 00000100:00100000:0.0:1784938787.750189:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 312 00000100:00100000:0.0:1784938787.750229:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+167:25046:x1871643326151296:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.750404:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ea8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.750421:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ea8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.750434:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ea8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.750449:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08eaf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x1cafb1a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.750456:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08eaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1cafb1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.750463:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08eaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1cafb1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.751080:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ea8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.751089:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ea8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.751096:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ea8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.751103:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.751107:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ea8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.751116:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ea8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.751140:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.751142:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.751148:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ea8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.751154:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ea8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.751171:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e05b334 reply state 00000000c5a61b9d transno 4294967518 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08eaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1cafb1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.751179:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.751280:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+169:25046:x1871643326151296:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1080us (1410us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1784938787.751289:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 312 00010000:00010000:3.0:1784938787.753960:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08eaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1cafb1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.753978:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08eaf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1cafb1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.753987:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08eaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1cafb1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.753994:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.753999:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08eaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1cafb1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.754006:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08eaf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1cafb1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.754023:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x1cafb1a6 (ffff97460a2ef000) 00010000:00010000:3.0:1784938787.754026:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.754032:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08eaf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1cafb1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.754038:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08eaf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1cafb1a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.756814:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.756893:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326151552 00000100:00100000:2.0:1784938787.756902:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326151552 00000100:00100000:2.0:1784938787.756956:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 313 00000100:00100000:2.0:1784938787.756966:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+168:25046:x1871643326151552:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.757104:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eb6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.757119:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eb6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.757131:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eb6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.757144:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08ebd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x9cb89017 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.757152:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08ebd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cb89017 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.757158:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08ebd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cb89017 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.757654:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eb6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.757673:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eb6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.757680:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eb6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.757686:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.757690:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eb6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.757699:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eb6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.757712:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.757715:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.757719:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eb6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.757725:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eb6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.757737:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000395c3a1b reply state 0000000003f75ba1 transno 4294967519 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08ebd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cb89017 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.757746:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.757853:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+170:25046:x1871643326151552:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 887us (1049us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1784938787.757861:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 313 00010000:00010000:1.0:1784938787.759870:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08ebd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cb89017 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.759886:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08ebd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cb89017 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.759893:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08ebd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cb89017 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.759899:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.759903:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08ebd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cb89017 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.759909:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08ebd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x9cb89017 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.759925:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x9cb89017 (ffff97472ff12e00) 00010000:00010000:1.0:1784938787.759928:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.759932:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08ebd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9cb89017 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.759938:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08ebd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x9cb89017 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.766444:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.766675:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326151808 00000100:00100000:0.0:1784938787.766685:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326151808 00000100:00100000:0.0:1784938787.766744:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 314 00000100:00100000:0.0:1784938787.766791:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+169:25046:x1871643326151808:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.766963:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ec4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.766980:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ec4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.766992:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ec4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.767007:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08ecb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x465a3d2b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.767022:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x465a3d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.767030:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x465a3d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.767603:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ec4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.767612:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ec4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.767618:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ec4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.767624:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.767629:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ec4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.767636:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ec4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.767649:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.767652:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.767657:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ec4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.767664:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ec4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.767679:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b16e1ef5 reply state 00000000e8be61e6 transno 4294967520 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x465a3d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.767695:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.768280:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+171:25046:x1871643326151808:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1524us (1842us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1784938787.768289:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 314 00010000:00010000:3.0:1784938787.770690:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x465a3d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.770708:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08ecb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x465a3d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.770731:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08ecb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x465a3d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.770737:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.770742:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08ecb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x465a3d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.770782:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08ecb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x465a3d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.770799:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x465a3d2b (ffff97460a2ef000) 00010000:00010000:3.0:1784938787.770802:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.770807:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08ecb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x465a3d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.770813:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0400/0xcd9d312a94a08ecb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x465a3d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.773319:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.773421:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326152064 00000100:00100000:2.0:1784938787.773432:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326152064 00000100:00100000:2.0:1784938787.773503:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 315 00000100:00100000:2.0:1784938787.773513:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+170:25046:x1871643326152064:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.773671:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ed2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.773689:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ed2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.773700:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ed2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.773714:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ed9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xf080d939 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.773721:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf080d939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.773727:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf080d939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.774335:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ed2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.774345:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ed2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.774351:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ed2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.774357:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.774361:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ed2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.774378:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ed2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.774392:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.774395:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.774400:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ed2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.774406:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08ed2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.774420:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009fe52f17 reply state 0000000038cf767e transno 4294967521 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf080d939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.774428:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.774508:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+172:25046:x1871643326152064:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 994us (1197us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1784938787.774516:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 315 00010000:00010000:1.0:1784938787.776983:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xf080d939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.777000:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ed9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf080d939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.777008:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ed9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf080d939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.777014:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.777018:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ed9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf080d939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.777026:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ed9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xf080d939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.777041:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xf080d939 (ffff97472ff12f00) 00010000:00010000:1.0:1784938787.777044:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.777048:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ed9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xf080d939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.777054:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ed9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xf080d939 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.777964:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.778174:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326152320 00000100:00100000:3.0:1784938787.778184:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326152320 00000100:00100000:3.0:1784938787.778249:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 316 00000100:00100000:3.0:1784938787.778268:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+171:25046:x1871643326152320:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.778409:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08ee0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.778424:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.778437:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.778467:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ee7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xd5576d3e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.778475:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd5576d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.778482:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd5576d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.779254:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.779405:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08ee0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.779413:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.779419:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.779423:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.779430:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08ee0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.779443:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.779446:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.779451:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08ee0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.779458:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08ee0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.779480:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b63893b7 reply state 00000000da8b0acd transno 4294967522 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd5576d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.779489:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.779635:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+173:25046:x1871643326152320:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1374us (1674us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1784938787.779644:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 316 00010000:00010000:3.0:1784938787.782435:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xd5576d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.782453:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ee7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd5576d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.782460:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd5576d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.782467:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.782472:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd5576d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.782480:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ee7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xd5576d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.782497:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xd5576d3e (ffff9747214ca500) 00010000:00010000:3.0:1784938787.782500:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.782505:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ee7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd5576d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.782511:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08ee7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xd5576d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.784125:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.784336:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326152576 00000100:00100000:2.0:1784938787.784348:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326152576 00000100:00100000:2.0:1784938787.784453:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 317 00000100:00100000:2.0:1784938787.784465:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+172:25046:x1871643326152576:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.784625:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.784642:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.784654:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.784686:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ef5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x2bdcdf35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.784694:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2bdcdf35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.784701:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2bdcdf35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.785325:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.785334:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.785342:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.785348:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.785352:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.785359:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.785372:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.785375:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.785380:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.785387:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08eee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.785407:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000513ea08b reply state 00000000629a08e2 transno 4294967523 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2bdcdf35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.785416:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.785502:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+174:25046:x1871643326152576:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1037us (1384us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1784938787.785511:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 317 00010000:00010000:1.0:1784938787.787794:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2bdcdf35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.787812:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ef5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2bdcdf35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.787840:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ef5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2bdcdf35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.787847:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.787852:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ef5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2bdcdf35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.787859:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ef5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2bdcdf35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.787876:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x2bdcdf35 (ffff97472ff12c00) 00010000:00010000:1.0:1784938787.787879:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.787884:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ef5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2bdcdf35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.787891:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08ef5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2bdcdf35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.794440:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.794570:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326152832 00000100:00100000:0.0:1784938787.794580:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326152832 00000100:00100000:0.0:1784938787.794669:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 318 00000100:00100000:0.0:1784938787.794679:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+173:25046:x1871643326152832:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.794865:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08efc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.794882:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08efc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.794892:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08efc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.794908:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08f03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x96e19429 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.794916:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08f03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x96e19429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.794922:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08f03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x96e19429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.795704:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08efc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.795714:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08efc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.795730:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08efc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.795736:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.795740:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08efc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.795748:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08efc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.795860:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.795863:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.795868:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08efc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.795874:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08efc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.795888:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b25f4ece reply state 00000000a217cc95 transno 4294967524 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08f03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x96e19429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.795896:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.796211:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+175:25046:x1871643326152832:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1521us (1770us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1784938787.796229:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 318 00000100:00100000:1.0:1784938787.801230:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.801340:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326153088 00000100:00100000:0.0:1784938787.801351:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326153088 00000100:00100000:0.0:1784938787.801416:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 319 00000100:00100000:0.0:1784938787.801426:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+175:25046:x1871643326153088:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.801615:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.801632:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.801645:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.801660:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x5373bd2a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.801667:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5373bd2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.801674:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5373bd2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.802285:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.802295:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f0a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.802302:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.802308:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.802313:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.802321:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.802343:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.802346:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.802351:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.802358:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.802371:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067637c70 reply state 0000000075f88acf transno 4294967525 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5373bd2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.802379:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.802473:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+177:25046:x1871643326153088:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1046us (1257us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1784938787.802481:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 319 00010000:00010000:3.0:1784938787.805050:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08f03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x96e19429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.805066:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08f03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x96e19429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.805073:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08f03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x96e19429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.805080:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.805084:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08f03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x96e19429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.805092:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08f03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x96e19429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.805110:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x96e19429 (ffff97460a2eff00) 00010000:00010000:3.0:1784938787.805113:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.805117:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08f03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x96e19429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.805124:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1000/0xcd9d312a94a08f03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x96e19429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.805467:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x5373bd2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.805476:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5373bd2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.805482:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5373bd2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.805487:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.805491:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5373bd2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.805498:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x5373bd2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.805527:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x5373bd2a (ffff97460a2ef600) 00010000:00010000:0.0:1784938787.805530:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.805534:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5373bd2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.805541:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x5373bd2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.807610:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.807886:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326153344 00000100:00100000:3.0:1784938787.807896:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326153344 00000100:00100000:3.0:1784938787.807957:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 320 00000100:00100000:3.0:1784938787.807966:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+175:25046:x1871643326153344:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.808145:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08f18 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.808171:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08f18 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.808185:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08f18 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.808211:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08f1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xddd68bd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.808219:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08f1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xddd68bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.808231:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08f1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xddd68bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.809545:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08f18 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.809557:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08f18 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.809564:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08f18 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.809572:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.809577:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08f18 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.809585:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08f18 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.809598:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.809611:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.809617:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08f18 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.809624:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08f18 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.809641:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000037194ab0 reply state 0000000063e1a271 transno 4294967526 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08f1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xddd68bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.809649:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.809739:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+177:25046:x1871643326153344:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1771us (2136us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1784938787.809748:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 320 00010000:00010000:3.0:1784938787.812938:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08f1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xddd68bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.812956:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08f1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xddd68bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.812964:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08f1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xddd68bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.812971:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.812976:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08f1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xddd68bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.812984:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08f1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xddd68bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.813001:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xddd68bd6 (ffff9747214ca500) 00010000:00010000:3.0:1784938787.813004:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.813026:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08f1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xddd68bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.813033:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08f1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xddd68bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.814538:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.814625:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326153600 00000100:00100000:0.0:1784938787.814636:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326153600 00000100:00100000:0.0:1784938787.814693:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 321 00000100:00100000:0.0:1784938787.814703:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602883c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+176:25046:x1871643326153600:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.814877:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.814895:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.814906:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.814920:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xa8ef4831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.814927:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa8ef4831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.814934:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa8ef4831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.815529:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.815539:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f26 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.815545:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.815552:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.815557:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.815565:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.815579:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.815582:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.815587:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.815593:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.815607:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce270228 reply state 000000005170ad57 transno 4294967527 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa8ef4831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.815616:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.815714:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602883c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+178:25046:x1871643326153600:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1011us (1184us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1784938787.815733:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 321 00010000:00010000:0.0:1784938787.820738:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xa8ef4831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.820783:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa8ef4831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.820792:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa8ef4831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.820799:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.820804:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa8ef4831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.820811:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xa8ef4831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.820829:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xa8ef4831 (ffff97460a2ef900) 00010000:00010000:0.0:1784938787.820832:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.820838:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xa8ef4831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.820844:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xa8ef4831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.823561:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.823651:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326153856 00000100:00100000:0.0:1784938787.823661:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326153856 00000100:00100000:0.0:1784938787.823724:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 322 00000100:00100000:0.0:1784938787.823734:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+177:25046:x1871643326153856:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.823901:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.823950:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.823961:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.823978:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x850cd536 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.823985:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x850cd536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.823991:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x850cd536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.824587:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.824596:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.824604:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.824611:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.824615:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.824623:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.824636:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.824645:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.824651:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.824658:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.824673:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000293b6e4 reply state 000000005170ad57 transno 4294967528 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x850cd536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.824682:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.824811:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+179:25046:x1871643326153856:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1076us (1260us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1784938787.824819:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 322 00010000:00010000:3.0:1784938787.827447:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x850cd536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.827465:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x850cd536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.827472:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x850cd536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.827478:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.827483:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x850cd536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.827492:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x850cd536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.827509:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x850cd536 (ffff97460a2ef600) 00010000:00010000:3.0:1784938787.827512:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.827517:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x850cd536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.827523:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a08f3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x850cd536 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.830380:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.830629:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326154112 00000100:00100000:0.0:1784938787.830640:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326154112 00000100:00100000:0.0:1784938787.830748:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 323 00000100:00100000:0.0:1784938787.830793:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+178:25046:x1871643326154112:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.830959:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.830979:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.830991:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.831006:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xac5a715f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.831013:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5a715f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.831034:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5a715f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.831587:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.831597:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f42 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.831604:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.831610:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.831614:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.831623:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.831636:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.831639:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.831643:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.831649:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.831663:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002426ba02 reply state 0000000075f88acf transno 4294967529 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5a715f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.831672:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.831792:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+180:25046:x1871643326154112:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 999us (1419us total) trans 4294967529 rc 0/0 00000100:00100000:0.0:1784938787.831800:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 323 00010000:00010000:2.0:1784938787.836060:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5a715f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.836078:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5a715f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.836085:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5a715f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.836092:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.836097:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5a715f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.836105:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xac5a715f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.836123:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xac5a715f (ffff97460a2ef900) 00010000:00010000:2.0:1784938787.836127:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.836132:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xac5a715f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.836138:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a08f49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xac5a715f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.836873:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.837496:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326154368 00000100:00100000:2.0:1784938787.837506:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326154368 00000100:00100000:2.0:1784938787.837561:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 324 00000100:00100000:2.0:1784938787.837570:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+179:25046:x1871643326154368:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.837716:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08f50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.837731:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08f50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.837743:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08f50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.837774:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08f57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x412442b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.837781:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08f57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x412442b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.837787:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08f57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x412442b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.843159:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08f50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.843177:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08f50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.843212:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08f50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.843330:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938787.843336:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08f50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.843346:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08f50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.843368:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:1.0:1784938787.843372:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938787.843377:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08f50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938787.843383:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00600/0xcd9d312a94a08f50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938787.843401:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005d222343 reply state 00000000ef475937 transno 4294967530 ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08f57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x412442b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.843411:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938787.843582:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+181:25046:x1871643326154368:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 6009us (6709us total) trans 4294967530 rc 0/0 00000100:00100000:1.0:1784938787.843591:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 324 00000100:00100000:1.0:1784938787.849051:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.849126:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326154624 00000100:00100000:2.0:1784938787.849137:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326154624 00000100:00100000:2.0:1784938787.849222:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 325 00000100:00100000:2.0:1784938787.849233:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+181:25046:x1871643326154624:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.849376:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08f5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.849413:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08f5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.849424:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08f5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.849441:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08f65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x8fc64da3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.849449:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x8fc64da3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.849455:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x8fc64da3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.850052:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08f5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.850061:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08f5e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.850068:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08f5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.850074:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.850078:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08f5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.850085:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08f5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.850098:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.850110:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.850116:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08f5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.850122:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01400/0xcd9d312a94a08f5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.850136:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004c14a3f4 reply state 00000000f7b982e1 transno 4294967531 ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x8fc64da3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.850146:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.850243:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+183:25046:x1871643326154624:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1009us (1200us total) trans 4294967531 rc 0/0 00000100:00100000:2.0:1784938787.850252:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 325 00010000:00010000:3.0:1784938787.850693:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08f57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x412442b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.850716:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08f57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x412442b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.850722:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08f57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x412442b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.850727:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.850731:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08f57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x412442b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.850737:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08f57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x412442b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.850747:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x412442b5 (ffff97472ff12c00) 00010000:00010000:3.0:1784938787.850779:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.850784:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08f57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x412442b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.850791:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01600/0xcd9d312a94a08f57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x412442b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.853507:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x8fc64da3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.853524:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08f65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x8fc64da3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.853531:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08f65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x8fc64da3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.853539:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924f400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.853544:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08f65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x8fc64da3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.853551:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08f65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x8fc64da3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.853567:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x8fc64da3 (ffff97472ff12f00) 00010000:00010000:0.0:1784938787.853570:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.853575:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08f65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x8fc64da3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.853581:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f400/0xcd9d312a94a08f65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x8fc64da3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.856570:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.857245:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326154880 00000100:00100000:2.0:1784938787.857255:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326154880 00000100:00100000:2.0:1784938787.857334:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 326 00000100:00100000:2.0:1784938787.857344:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+181:25046:x1871643326154880:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.857483:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08f6c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.857496:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08f6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.857505:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08f6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.857515:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x51a9f398 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.857520:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x51a9f398 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.857531:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x51a9f398 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.858095:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08f6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.858104:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08f6c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.858111:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08f6c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.858117:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.858120:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08f6c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.858126:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08f6c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.858135:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.858137:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.858141:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08f6c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.858145:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892000/0xcd9d312a94a08f6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.858154:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4c1258b reply state 000000009da2d014 transno 4294967532 ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x51a9f398 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.858161:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.858267:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+183:25046:x1871643326154880:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 922us (1706us total) trans 4294967532 rc 0/0 00000100:00100000:2.0:1784938787.858275:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 326 00000100:00100000:2.0:1784938787.861504:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1784938787.861611:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x51a9f398 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.861623:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x51a9f398 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.861630:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x51a9f398 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.861636:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.861654:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x51a9f398 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.861662:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x51a9f398 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.861679:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x51a9f398 (ffff97472ff12e00) 00010000:00010000:3.0:1784938787.861682:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.861697:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x51a9f398 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.861705:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x51a9f398 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.862004:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326155136 00000100:00100000:0.0:1784938787.862014:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326155136 00000100:00100000:0.0:1784938787.862098:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 327 00000100:00100000:0.0:1784938787.862109:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+182:25046:x1871643326155136:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.862415:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f7a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.862432:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.862444:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.862459:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x87e6b044 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.862467:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x87e6b044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.862472:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x87e6b044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.863627:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.863639:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f7a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.863646:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.863653:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.863657:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.863664:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f7a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.863696:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.863699:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.863704:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.863710:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08f7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.863725:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d251869d reply state 000000007803ee0a transno 4294967533 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x87e6b044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.863734:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.864103:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+184:25046:x1871643326155136:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1992us (2605us total) trans 4294967533 rc 0/0 00000100:00100000:0.0:1784938787.864113:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 327 00000100:00100000:1.0:1784938787.867514:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1784938787.867578:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x87e6b044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.867591:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x87e6b044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.867599:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x87e6b044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.867606:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.867611:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x87e6b044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.867620:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x87e6b044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.867659:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x87e6b044 (ffff97460a2ef500) 00010000:00010000:0.0:1784938787.867662:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.867667:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x87e6b044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.867673:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08f81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x87e6b044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.867874:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326155392 00000100:00100000:2.0:1784938787.867885:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326155392 00000100:00100000:2.0:1784938787.867971:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 328 00000100:00100000:2.0:1784938787.867981:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+183:25046:x1871643326155392:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.868127:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.868142:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.868151:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.868166:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47e00/0xcd9d312a94a08f8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x4e2ae2e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.868172:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47e00/0xcd9d312a94a08f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e2ae2e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.868179:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47e00/0xcd9d312a94a08f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e2ae2e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.868794:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.868803:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f88 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.868821:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.868827:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.868831:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.868838:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.868848:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.868851:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.868854:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.868860:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893600/0xcd9d312a94a08f88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.868873:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f52d3c2f reply state 00000000d1067156 transno 4294967534 ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47e00/0xcd9d312a94a08f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e2ae2e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.868881:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.868968:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+185:25046:x1871643326155392:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 987us (1462us total) trans 4294967534 rc 0/0 00000100:00100000:2.0:1784938787.868976:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 328 00010000:00010000:3.0:1784938787.872351:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47e00/0xcd9d312a94a08f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e2ae2e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.872368:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47e00/0xcd9d312a94a08f8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e2ae2e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.872376:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47e00/0xcd9d312a94a08f8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e2ae2e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.872382:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47e00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.872387:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47e00/0xcd9d312a94a08f8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e2ae2e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.872395:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47e00/0xcd9d312a94a08f8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e2ae2e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.872413:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4e2ae2e7 (ffff97472ff12100) 00010000:00010000:3.0:1784938787.872416:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.872436:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47e00/0xcd9d312a94a08f8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4e2ae2e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.872443:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47e00/0xcd9d312a94a08f8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4e2ae2e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.872549:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.877712:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326155648 00000100:00100000:0.0:1784938787.877727:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326155648 00000100:00100000:0.0:1784938787.877819:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 329 00000100:00100000:0.0:1784938787.877830:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+184:25046:x1871643326155648:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.878003:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08f96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.878022:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08f96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.878034:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08f96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.878051:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08f9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x2a02f5ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.878059:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2a02f5ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.878065:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2a02f5ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.878716:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08f96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.878726:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08f96 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.878733:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08f96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.878739:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.878744:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08f96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.878784:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08f96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.878797:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.878800:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.878804:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08f96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.878810:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08f96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.878826:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056f2a1b2 reply state 0000000047dbed63 transno 4294967535 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2a02f5ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.878834:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.878935:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+186:25046:x1871643326155648:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1104us (6387us total) trans 4294967535 rc 0/0 00000100:00100000:0.0:1784938787.878954:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 329 00000100:00100000:1.0:1784938787.884297:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1784938787.884433:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2a02f5ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.884447:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08f9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2a02f5ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.884475:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2a02f5ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.884481:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.884485:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2a02f5ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.884492:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08f9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2a02f5ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.884510:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x2a02f5ea (ffff97460a2ef700) 00010000:00010000:2.0:1784938787.884513:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.884517:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08f9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2a02f5ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.884523:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1600/0xcd9d312a94a08f9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2a02f5ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.884678:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326155904 00000100:00100000:0.0:1784938787.884688:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326155904 00000100:00100000:0.0:1784938787.884735:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 330 00000100:00100000:0.0:1784938787.884745:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+185:25046:x1871643326155904:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.885051:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fa4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.885066:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.885077:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.885091:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08fab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x626dc634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.885098:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x626dc634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.885105:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x626dc634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.886429:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.886442:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fa4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.886449:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.886465:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.886469:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.886477:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fa4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.886491:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.886494:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.886498:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fa4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.886505:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fa4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.886520:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000008cc897a reply state 000000008f5499c1 transno 4294967536 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x626dc634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.886529:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.886686:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+187:25046:x1871643326155904:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1939us (2396us total) trans 4294967536 rc 0/0 00000100:00100000:0.0:1784938787.886695:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 330 00000100:00100000:1.0:1784938787.891346:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:3.0:1784938787.891535:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x626dc634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.891548:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08fab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x626dc634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.891556:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x626dc634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.891562:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.891567:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x626dc634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.891576:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08fab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x626dc634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.891594:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x626dc634 (ffff97460a2ef300) 00010000:00010000:3.0:1784938787.891597:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.891603:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08fab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x626dc634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.891610:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a08fab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x626dc634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.892134:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326156160 00000100:00100000:2.0:1784938787.892145:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326156160 00000100:00100000:2.0:1784938787.892205:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 331 00000100:00100000:2.0:1784938787.892215:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+186:25046:x1871643326156160:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.892353:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a08fb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.892368:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a08fb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.892378:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a08fb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.892404:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47c00/0xcd9d312a94a08fb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xbbfa4cf9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.892409:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47c00/0xcd9d312a94a08fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbbfa4cf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.892414:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47c00/0xcd9d312a94a08fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbbfa4cf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.892893:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a08fb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.892899:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a08fb2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.892903:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a08fb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.892907:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.892911:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a08fb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.892917:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a08fb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.892928:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.892931:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.892935:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a08fb2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.892941:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a08fb2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.892960:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dabace36 reply state 000000002581db39 transno 4294967537 ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47c00/0xcd9d312a94a08fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbbfa4cf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.892968:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.893056:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+188:25046:x1871643326156160:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 840us (1717us total) trans 4294967537 rc 0/0 00000100:00100000:2.0:1784938787.893064:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 331 00000100:00100000:1.0:1784938787.896681:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.896785:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326156416 00000100:00100000:3.0:1784938787.896795:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326156416 00000100:00100000:3.0:1784938787.896842:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 332 00000100:00100000:3.0:1784938787.896863:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+188:25046:x1871643326156416:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.897009:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fc0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.897026:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.897037:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.897051:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x25a35a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.897058:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x25a35a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.897064:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x25a35a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.897642:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.897650:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fc0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.897658:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.897664:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.897669:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.897687:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fc0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.897701:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.897704:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.897710:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fc0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.897717:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.897730:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e05b334 reply state 00000000dae18dbf transno 4294967538 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x25a35a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.897738:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.897866:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+190:25046:x1871643326156416:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1001us (1193us total) trans 4294967538 rc 0/0 00000100:00100000:3.0:1784938787.897874:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 332 00010000:00010000:2.0:1784938787.898341:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47c00/0xcd9d312a94a08fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xbbfa4cf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.898352:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47c00/0xcd9d312a94a08fb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbbfa4cf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.898357:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47c00/0xcd9d312a94a08fb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbbfa4cf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.898362:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.898365:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47c00/0xcd9d312a94a08fb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbbfa4cf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.898371:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47c00/0xcd9d312a94a08fb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xbbfa4cf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.898381:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xbbfa4cf9 (ffff97472ff12d00) 00010000:00010000:2.0:1784938787.898383:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.898387:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47c00/0xcd9d312a94a08fb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbbfa4cf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.898392:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47c00/0xcd9d312a94a08fb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xbbfa4cf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.901337:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x25a35a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.901354:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x25a35a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.901362:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x25a35a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.901369:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.901373:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x25a35a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.901403:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fc7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x25a35a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.901420:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x25a35a1 (ffff9747214ca500) 00010000:00010000:3.0:1784938787.901424:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.901429:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fc7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x25a35a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.901436:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x25a35a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.903503:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.903855:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326156672 00000100:00100000:0.0:1784938787.903866:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326156672 00000100:00100000:0.0:1784938787.903944:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 333 00000100:00100000:0.0:1784938787.903954:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+188:25046:x1871643326156672:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.904123:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.904162:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.904175:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.904192:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08fd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xaa84f6fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.904211:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa84f6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.904219:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa84f6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.905005:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.905015:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.905022:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.905028:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.905033:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.905041:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.905055:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.905066:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.905071:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.905078:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.905092:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000395c3a1b reply state 0000000083940660 transno 4294967539 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa84f6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.905101:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.905189:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+190:25046:x1871643326156672:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1234us (1694us total) trans 4294967539 rc 0/0 00000100:00100000:0.0:1784938787.905208:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 333 00010000:00010000:2.0:1784938787.907715:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa84f6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.907733:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08fd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa84f6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.907741:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08fd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa84f6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.907748:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.907808:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08fd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa84f6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.907815:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08fd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xaa84f6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.907831:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xaa84f6fb (ffff97460a2ef500) 00010000:00010000:2.0:1784938787.907833:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.907838:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08fd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xaa84f6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.907845:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a08fd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xaa84f6fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.911321:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.911404:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326156928 00000100:00100000:3.0:1784938787.911415:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326156928 00000100:00100000:3.0:1784938787.911476:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 334 00000100:00100000:3.0:1784938787.911486:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+189:25046:x1871643326156928:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.911636:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.911654:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.911666:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.911680:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fe3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xc4008f45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.911687:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc4008f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.911714:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc4008f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.912321:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.912332:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fdc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.912339:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.912346:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.912350:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.912358:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fdc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.912371:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.912374:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.912379:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fdc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.912385:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045200/0xcd9d312a94a08fdc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.912398:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b16e1ef5 reply state 000000009fe7a0a2 transno 4294967540 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc4008f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.912406:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.912496:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+191:25046:x1871643326156928:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1010us (1184us total) trans 4294967540 rc 0/0 00000100:00100000:3.0:1784938787.912504:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 334 00010000:00010000:3.0:1784938787.916066:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc4008f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.916083:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fe3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc4008f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.916092:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fe3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc4008f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.916098:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.916103:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fe3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc4008f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.916111:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fe3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc4008f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.916127:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc4008f45 (ffff9747214ca500) 00010000:00010000:3.0:1784938787.916130:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.916134:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fe3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc4008f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.916140:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a08fe3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc4008f45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.917249:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.917341:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326157184 00000100:00100000:0.0:1784938787.917352:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326157184 00000100:00100000:0.0:1784938787.917412:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 335 00000100:00100000:0.0:1784938787.917423:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+190:25046:x1871643326157184:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.917576:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.917592:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.917604:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.917618:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ff1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x856ac3de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.917625:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ff1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x856ac3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.917643:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ff1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x856ac3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.918259:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.918268:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.918276:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.918282:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.918286:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.918293:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.918305:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.918308:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.918313:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.918319:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a08fea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.918332:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009fe52f17 reply state 00000000a1b5ef50 transno 4294967541 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ff1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x856ac3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.918341:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.918425:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+192:25046:x1871643326157184:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1003us (1182us total) trans 4294967541 rc 0/0 00000100:00100000:0.0:1784938787.918434:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 335 00010000:00010000:2.0:1784938787.920915:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ff1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x856ac3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.920931:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ff1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x856ac3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.920938:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ff1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x856ac3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.920958:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.920963:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ff1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x856ac3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.920972:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ff1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x856ac3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.920986:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x856ac3de (ffff97460a2efe00) 00010000:00010000:2.0:1784938787.920989:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.920993:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ff1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x856ac3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.920999:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0c00/0xcd9d312a94a08ff1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x856ac3de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.922290:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938787.922513:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326157440 00000100:00100000:3.0:1784938787.922524:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326157440 00000100:00100000:3.0:1784938787.922581:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 336 00000100:00100000:3.0:1784938787.922590:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+191:25046:x1871643326157440:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.922804:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ff8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.922821:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ff8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.922833:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ff8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.922849:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08fff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x52fd3bf5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.922856:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08fff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x52fd3bf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.922862:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08fff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x52fd3bf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.923734:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ff8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.923744:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ff8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.923788:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ff8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.923795:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.923800:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ff8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.923809:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ff8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.923833:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.923837:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.923843:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ff8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.923849:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a08ff8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.923866:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b63893b7 reply state 00000000478e5a4e transno 4294967542 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08fff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x52fd3bf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.923874:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.924485:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+193:25046:x1871643326157440:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1888us (2198us total) trans 4294967542 rc 0/0 00000100:00100000:3.0:1784938787.924495:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 336 00010000:00010000:3.0:1784938787.926399:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08fff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x52fd3bf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.926414:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08fff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x52fd3bf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.926421:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08fff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x52fd3bf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.926426:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.926431:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08fff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x52fd3bf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.926437:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08fff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x52fd3bf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.926473:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x52fd3bf5 (ffff9747214ca600) 00010000:00010000:3.0:1784938787.926476:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.926481:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08fff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x52fd3bf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.926487:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a08fff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x52fd3bf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.927449:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.927667:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326157696 00000100:00100000:0.0:1784938787.927679:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326157696 00000100:00100000:0.0:1784938787.927736:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 337 00000100:00100000:0.0:1784938787.927746:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+192:25046:x1871643326157696:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.928059:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09006 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.928076:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09006 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.928087:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09006 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.928101:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a0900d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x63584801 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.928108:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a0900d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x63584801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.928114:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a0900d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x63584801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.928739:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09006 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.929394:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09006 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.929407:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09006 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.929426:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.929431:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09006 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.929441:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09006 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.929457:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.929460:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.929465:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09006 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.929471:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09006 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.929488:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000513ea08b reply state 000000000274630e transno 4294967543 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a0900d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x63584801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.929497:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938787.930120:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+194:25046:x1871643326157696:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 2368us (2670us total) trans 4294967543 rc 0/0 00000100:00100000:1.0:1784938787.930132:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 337 00000100:00100000:1.0:1784938787.932834:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.933657:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326157952 00000100:00100000:0.0:1784938787.933670:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326157952 00000100:00100000:0.0:1784938787.933725:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 338 00000100:00100000:0.0:1784938787.933735:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+194:25046:x1871643326157952:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.933916:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09014 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.933933:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09014 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.933945:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09014 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.933981:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a0901b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x3833ff15 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.933988:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a0901b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x3833ff15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.933995:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a0901b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x3833ff15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.935003:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09014 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.935014:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09014 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.935021:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09014 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.935027:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.935031:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09014 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.935039:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09014 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.935053:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.935056:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.935061:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09014 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.935067:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09014 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.935092:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b25f4ece reply state 00000000c6f1a655 transno 4294967544 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a0901b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x3833ff15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.935101:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.935443:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+196:25046:x1871643326157952:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1706us (2616us total) trans 4294967544 rc 0/0 00000100:00100000:0.0:1784938787.935452:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 338 00010000:00010000:2.0:1784938787.935547:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a0900d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x63584801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.935556:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a0900d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x63584801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.935562:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a0900d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x63584801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.935567:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.935571:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a0900d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x63584801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.935577:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a0900d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x63584801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.935602:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x63584801 (ffff97460a2ef200) 00010000:00010000:2.0:1784938787.935605:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.935608:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a0900d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x63584801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.935614:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0a00/0xcd9d312a94a0900d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x63584801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.938132:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a0901b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x3833ff15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.938149:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a0901b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x3833ff15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.938156:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a0901b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x3833ff15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.938162:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.938167:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a0901b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x3833ff15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.938174:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a0901b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x3833ff15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.938191:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x3833ff15 (ffff97460a2efd00) 00010000:00010000:3.0:1784938787.938194:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.938208:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a0901b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x3833ff15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.938214:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0600/0xcd9d312a94a0901b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x3833ff15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.941289:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.941493:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326158208 00000100:00100000:2.0:1784938787.941503:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326158208 00000100:00100000:2.0:1784938787.941569:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 339 00000100:00100000:2.0:1784938787.941579:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+194:25046:x1871643326158208:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.941782:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a09022 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.941798:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a09022 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.941810:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a09022 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.941825:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46a00/0xcd9d312a94a09029 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x4a8d7a58 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.941832:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46a00/0xcd9d312a94a09029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4a8d7a58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.941839:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46a00/0xcd9d312a94a09029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4a8d7a58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.942585:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a09022 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.942597:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a09022 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.942603:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a09022 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.942610:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.942614:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a09022 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.942623:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a09022 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.942638:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.942641:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.942646:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a09022 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.942653:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a09022 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.942666:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067637c70 reply state 00000000b7668d82 transno 4294967545 ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46a00/0xcd9d312a94a09029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4a8d7a58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.942978:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.943114:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+196:25046:x1871643326158208:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1532us (1831us total) trans 4294967545 rc 0/0 00000100:00100000:2.0:1784938787.943135:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 339 00010000:00010000:0.0:1784938787.946107:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46a00/0xcd9d312a94a09029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4a8d7a58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.946125:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46a00/0xcd9d312a94a09029 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4a8d7a58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.946132:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46a00/0xcd9d312a94a09029 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4a8d7a58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.946138:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.946144:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46a00/0xcd9d312a94a09029 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4a8d7a58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.946152:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46a00/0xcd9d312a94a09029 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4a8d7a58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.946168:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4a8d7a58 (ffff97472ff12d00) 00010000:00010000:0.0:1784938787.946170:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.946175:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46a00/0xcd9d312a94a09029 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4a8d7a58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.946181:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46a00/0xcd9d312a94a09029 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4a8d7a58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.946698:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.947051:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326158464 00000100:00100000:0.0:1784938787.947061:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326158464 00000100:00100000:0.0:1784938787.947118:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 340 00000100:00100000:0.0:1784938787.947127:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+195:25046:x1871643326158464:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.947291:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09030 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.947306:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09030 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.947317:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09030 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.947332:0:33061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a09037 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xc30d1639 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.947339:0:33061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a09037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc30d1639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.947345:0:33061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a09037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc30d1639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.948555:0:33061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09030 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.948567:0:33061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09030 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.948575:0:33061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09030 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.948597:0:33061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.948601:0:33061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09030 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.948609:0:33061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09030 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.948624:0:33061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.948627:0:33061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.948632:0:33061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09030 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.948637:0:33061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09030 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.948652:0:33061:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048909dc4 reply state 00000000c0548a79 transno 4294967546 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a09037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc30d1639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.948661:0:33061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.949010:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+197:25046:x1871643326158464:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1880us (2313us total) trans 4294967546 rc 0/0 00000100:00100000:0.0:1784938787.949020:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 340 00010000:00010000:0.0:1784938787.951029:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a09037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc30d1639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.951046:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a09037 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc30d1639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.951053:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a09037 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc30d1639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.951080:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.951085:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a09037 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc30d1639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.951093:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a09037 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc30d1639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.951109:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc30d1639 (ffff97460a2efc00) 00010000:00010000:0.0:1784938787.951112:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.951116:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a09037 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc30d1639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.951122:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1800/0xcd9d312a94a09037 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc30d1639 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.953919:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.954384:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326158720 00000100:00100000:2.0:1784938787.954395:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326158720 00000100:00100000:2.0:1784938787.954448:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 341 00000100:00100000:2.0:1784938787.954458:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+196:25046:x1871643326158720:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.954619:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a0903e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.954638:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a0903e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.954651:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a0903e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.954666:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47a00/0xcd9d312a94a09045 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x2d0e6ac8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.954673:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47a00/0xcd9d312a94a09045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2d0e6ac8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.954692:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47a00/0xcd9d312a94a09045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2d0e6ac8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.956033:0:30632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a0903e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.956046:0:30632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a0903e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.956054:0:30632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a0903e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.956073:0:30632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.956078:0:30632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a0903e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.956086:0:30632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a0903e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.956102:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.956105:0:30632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.956110:0:30632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a0903e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.956116:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a0903e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.956132:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000037194ab0 reply state 0000000038cf767e transno 4294967547 ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47a00/0xcd9d312a94a09045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2d0e6ac8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.956141:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.956257:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+198:25046:x1871643326158720:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1797us (2354us total) trans 4294967547 rc 0/0 00000100:00100000:2.0:1784938787.956273:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 341 00010000:00010000:0.0:1784938787.959110:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47a00/0xcd9d312a94a09045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x2d0e6ac8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.959129:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47a00/0xcd9d312a94a09045 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2d0e6ac8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.959137:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47a00/0xcd9d312a94a09045 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2d0e6ac8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.959143:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.959148:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47a00/0xcd9d312a94a09045 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2d0e6ac8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.959155:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47a00/0xcd9d312a94a09045 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x2d0e6ac8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.959194:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x2d0e6ac8 (ffff97472ff12600) 00010000:00010000:0.0:1784938787.959207:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.959212:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47a00/0xcd9d312a94a09045 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2d0e6ac8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.959227:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47a00/0xcd9d312a94a09045 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x2d0e6ac8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.962045:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.962243:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326158976 00000100:00100000:2.0:1784938787.962255:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326158976 00000100:00100000:2.0:1784938787.962328:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 342 00000100:00100000:2.0:1784938787.962339:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+197:25046:x1871643326158976:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.962499:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0904c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.962537:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0904c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.962551:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0904c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.962567:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46000/0xcd9d312a94a09053 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xfed6d405 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.962575:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46000/0xcd9d312a94a09053 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xfed6d405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.962582:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46000/0xcd9d312a94a09053 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xfed6d405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.963216:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0904c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.963226:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0904c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.963233:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0904c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.963239:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.963244:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0904c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.963252:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0904c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.963267:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.963277:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.963283:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0904c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.963290:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0904c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.963305:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007235fb3a reply state 00000000629a08e2 transno 4294967548 ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46000/0xcd9d312a94a09053 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xfed6d405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.963315:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.963414:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+199:25046:x1871643326158976:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1075us (1376us total) trans 4294967548 rc 0/0 00000100:00100000:2.0:1784938787.963423:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 342 00010000:00010000:0.0:1784938787.967333:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46000/0xcd9d312a94a09053 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xfed6d405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.967350:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46000/0xcd9d312a94a09053 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xfed6d405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.967359:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46000/0xcd9d312a94a09053 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xfed6d405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.967366:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.967371:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46000/0xcd9d312a94a09053 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xfed6d405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.967379:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46000/0xcd9d312a94a09053 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xfed6d405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.967401:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xfed6d405 (ffff97472ff12100) 00010000:00010000:0.0:1784938787.967404:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.967409:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46000/0xcd9d312a94a09053 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xfed6d405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.967416:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46000/0xcd9d312a94a09053 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xfed6d405 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.969257:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.969468:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326159232 00000100:00100000:2.0:1784938787.969478:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326159232 00000100:00100000:2.0:1784938787.969539:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 343 00000100:00100000:2.0:1784938787.969550:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+198:25046:x1871643326159232:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.969701:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a0905a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.969719:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a0905a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.969731:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a0905a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.969746:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47200/0xcd9d312a94a09061 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xba34caf2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.969771:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47200/0xcd9d312a94a09061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xba34caf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.969789:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47200/0xcd9d312a94a09061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xba34caf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.970388:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a0905a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.970398:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a0905a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.970404:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a0905a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.970409:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.970413:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a0905a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.970420:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a0905a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.970433:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.970436:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.970441:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a0905a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.970448:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a0905a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.970464:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed56500a reply state 00000000a236e65a transno 4294967549 ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47200/0xcd9d312a94a09061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xba34caf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.970475:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.970593:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+200:25046:x1871643326159232:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1042us (1339us total) trans 4294967549 rc 0/0 00000100:00100000:2.0:1784938787.970603:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 343 00010000:00010000:0.0:1784938787.977390:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47200/0xcd9d312a94a09061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xba34caf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.977413:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47200/0xcd9d312a94a09061 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xba34caf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.977420:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47200/0xcd9d312a94a09061 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xba34caf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.977427:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.977433:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47200/0xcd9d312a94a09061 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xba34caf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.977442:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47200/0xcd9d312a94a09061 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xba34caf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.977461:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xba34caf2 (ffff97472ff12e00) 00010000:00010000:0.0:1784938787.977464:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.977469:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47200/0xcd9d312a94a09061 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xba34caf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.977475:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47200/0xcd9d312a94a09061 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xba34caf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938787.983477:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938787.983748:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326159488 00000100:00100000:2.0:1784938787.983791:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326159488 00000100:00100000:2.0:1784938787.983845:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 344 00000100:00100000:2.0:1784938787.983855:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+199:25046:x1871643326159488:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938787.984014:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09068 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.984032:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09068 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.984044:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09068 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.984059:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0906f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x41369d47 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.984065:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0906f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x41369d47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.984073:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0906f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x41369d47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.984645:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09068 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.984654:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09068 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.984662:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09068 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.984675:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938787.984679:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09068 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.984688:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09068 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.984700:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938787.984703:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938787.984708:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09068 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938787.984716:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09068 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938787.984729:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046be20c4 reply state 00000000e3bead6d transno 4294967550 ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0906f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x41369d47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.984737:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938787.984854:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+201:25046:x1871643326159488:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 999us (1383us total) trans 4294967550 rc 0/0 00000100:00100000:2.0:1784938787.984863:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 344 00000100:00100000:2.0:1784938787.989095:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1784938787.989303:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0906f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x41369d47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.989317:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0906f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x41369d47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.989325:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0906f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x41369d47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.989350:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.989356:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0906f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x41369d47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.989364:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0906f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x41369d47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.989382:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x41369d47 (ffff97472ff12f00) 00010000:00010000:0.0:1784938787.989385:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.989390:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0906f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x41369d47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.989396:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47800/0xcd9d312a94a0906f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x41369d47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.989809:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326159744 00000100:00100000:3.0:1784938787.989821:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326159744 00000100:00100000:3.0:1784938787.989876:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 345 00000100:00100000:3.0:1784938787.989885:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+200:25046:x1871643326159744:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938787.990019:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09076 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.990035:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09076 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.990045:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09076 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.990059:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a0907d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xfa4a3bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.990066:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a0907d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xfa4a3bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.990073:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a0907d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xfa4a3bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.990635:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09076 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.990645:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09076 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.990653:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09076 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.990666:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938787.990669:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09076 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.990677:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09076 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.990689:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938787.990692:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938787.990696:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09076 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938787.990703:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09076 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938787.990717:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000543f5055 reply state 000000006e40cb6e transno 4294967551 ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a0907d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xfa4a3bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938787.990724:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938787.990850:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+202:25046:x1871643326159744:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 964us (1763us total) trans 4294967551 rc 0/0 00000100:00100000:3.0:1784938787.990859:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 345 00010000:00010000:0.0:1784938787.994002:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a0907d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xfa4a3bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.994021:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a0907d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xfa4a3bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.994030:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a0907d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xfa4a3bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.994036:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742044200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.994041:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a0907d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xfa4a3bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.994049:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a0907d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xfa4a3bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.994089:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xfa4a3bcb (ffff9747214ca600) 00010000:00010000:0.0:1784938787.994092:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.994098:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a0907d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xfa4a3bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.994105:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044200/0xcd9d312a94a0907d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xfa4a3bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938787.995431:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938787.995642:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326160000 00000100:00100000:0.0:1784938787.995654:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326160000 00000100:00100000:0.0:1784938787.995714:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 346 00000100:00100000:0.0:1784938787.995724:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+201:25046:x1871643326160000:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938787.995902:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09084 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.995929:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09084 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.995940:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09084 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.995954:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a0908b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x1ac44964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.995961:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a0908b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1ac44964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.995968:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a0908b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1ac44964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.996533:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09084 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.996543:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09084 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.996549:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09084 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.996556:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.996561:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09084 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.996569:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09084 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.996581:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938787.996584:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.996589:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09084 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.996594:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09084 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938787.996606:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6e4f81c reply state 0000000066b66ead transno 4294967552 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a0908b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1ac44964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938787.996615:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938787.996694:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+203:25046:x1871643326160000:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 970us (1268us total) trans 4294967552 rc 0/0 00000100:00100000:0.0:1784938787.996712:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 346 00010000:00010000:0.0:1784938787.999427:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a0908b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x1ac44964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.999445:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a0908b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1ac44964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.999453:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a0908b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1ac44964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.999459:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938787.999465:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a0908b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1ac44964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.999473:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a0908b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x1ac44964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.999489:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x1ac44964 (ffff97460a2efc00) 00010000:00010000:0.0:1784938787.999492:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938787.999498:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a0908b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1ac44964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938787.999504:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a0908b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x1ac44964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938788.002341:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938788.002429:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326160256 00000100:00100000:3.0:1784938788.002440:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326160256 00000100:00100000:3.0:1784938788.002523:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 347 00000100:00100000:3.0:1784938788.002533:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+202:25046:x1871643326160256:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:3.0:1784938788.002678:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09092 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938788.002713:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09092 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938788.002725:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09092 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938788.002742:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a09099 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x77039835 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938788.002781:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a09099 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x77039835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938788.002790:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a09099 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x77039835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938788.003333:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09092 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938788.003341:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09092 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938788.003348:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09092 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938788.003355:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045a00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:3.0:1784938788.003359:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09092 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938788.003366:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09092 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938788.003379:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:3.0:1784938788.003390:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938788.003395:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09092 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938788.003401:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045a00/0xcd9d312a94a09092 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938788.003414:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034a95e6c reply state 00000000b74deecb transno 4294967553 ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a09099 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x77039835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938788.003422:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938788.003511:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+204:25046:x1871643326160256:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 977us (1179us total) trans 4294967553 rc 0/0 00000100:00100000:3.0:1784938788.003520:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 347 00000100:00080000:1.0:1784938788.003887:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784938788.006213:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a09099 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x77039835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.006236:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a09099 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x77039835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.006273:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a09099 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x77039835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.006279:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938788.006284:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a09099 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x77039835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.006292:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a09099 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x77039835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.006307:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x77039835 (ffff9747214ca500) 00010000:00010000:0.0:1784938788.006310:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938788.006315:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a09099 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x77039835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.006321:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045400/0xcd9d312a94a09099 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x77039835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938788.009349:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938788.009423:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326160512 00000100:00100000:0.0:1784938788.009434:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326160512 00000100:00100000:0.0:1784938788.009498:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 348 00000100:00100000:0.0:1784938788.009509:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+203:25046:x1871643326160512:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938788.009667:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.009686:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.009699:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.009732:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xeba6f109 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.009740:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xeba6f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.009747:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xeba6f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.010378:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.010387:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.010394:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.010400:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938788.010404:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.010412:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.010425:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938788.010428:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938788.010433:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.010439:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938788.010461:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ebfb0072 reply state 000000004dc2206d transno 4294967554 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xeba6f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938788.010470:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938788.010547:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+205:25046:x1871643326160512:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1038us (1209us total) trans 4294967554 rc 0/0 00000100:00100000:0.0:1784938788.010554:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 348 00000100:00100000:3.0:1784938788.014846:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1784938788.014957:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xeba6f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.014972:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xeba6f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.014979:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xeba6f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.014985:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938788.014990:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xeba6f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.014998:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xeba6f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.015015:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xeba6f109 (ffff97460a2ef800) 00010000:00010000:0.0:1784938788.015018:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938788.015023:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xeba6f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.015029:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xeba6f109 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938788.015370:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326160768 00000100:00100000:2.0:1784938788.015380:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326160768 00000100:00100000:2.0:1784938788.015435:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 349 00000100:00100000:2.0:1784938788.015452:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+204:25046:x1871643326160768:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938788.015586:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.015601:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.015611:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.015625:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a090b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x19dea325 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.015632:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a090b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x19dea325 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.015638:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a090b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x19dea325 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.016530:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.016541:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.016548:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.016554:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938788.016558:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.016575:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.016588:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938788.016591:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938788.016595:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.016601:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938788.016614:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000738154de reply state 0000000070178c84 transno 4294967555 ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a090b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x19dea325 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938788.016623:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938788.016726:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+206:25046:x1871643326160768:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1272us (1888us total) trans 4294967555 rc 0/0 00000100:00100000:2.0:1784938788.016735:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 349 00010000:00010000:0.0:1784938788.019240:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a090b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x19dea325 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.019256:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a090b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x19dea325 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.019270:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a090b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x19dea325 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.019276:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46c00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938788.019281:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a090b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x19dea325 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.019288:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a090b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x19dea325 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.019304:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x19dea325 (ffff97472ff12c00) 00010000:00010000:0.0:1784938788.019306:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938788.019311:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a090b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x19dea325 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.019317:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46c00/0xcd9d312a94a090b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x19dea325 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938788.022295:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938788.022389:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326161024 00000100:00100000:0.0:1784938788.022399:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326161024 00000100:00100000:0.0:1784938788.022464:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 350 00000100:00100000:0.0:1784938788.022476:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+205:25046:x1871643326161024:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938788.022643:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.022680:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.022693:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.022709:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x76898bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.022716:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x76898bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.022723:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x76898bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.023345:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.023356:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.023363:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.023369:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938788.023373:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.023382:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.023395:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938788.023404:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938788.023410:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.023416:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938788.023430:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000fdc030b reply state 00000000b2e3339d transno 4294967556 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x76898bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938788.023438:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938788.023526:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+207:25046:x1871643326161024:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1052us (1240us total) trans 4294967556 rc 0/0 00000100:00100000:0.0:1784938788.023535:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 350 00010000:00010000:0.0:1784938788.026169:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x76898bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.026189:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x76898bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.026207:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x76898bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.026215:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938788.026227:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x76898bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.026236:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x76898bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.026254:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x76898bf8 (ffff97460a2ef800) 00010000:00010000:0.0:1784938788.026257:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938788.026287:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x76898bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.026294:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x76898bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938788.029135:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938788.029364:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326161280 00000100:00100000:2.0:1784938788.029374:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326161280 00000100:00100000:2.0:1784938788.029435:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 351 00000100:00100000:2.0:1784938788.029444:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+206:25046:x1871643326161280:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938788.029610:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.029629:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.029642:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.029675:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47600/0xcd9d312a94a090d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x16436b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.029682:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47600/0xcd9d312a94a090d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x16436b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.029689:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47600/0xcd9d312a94a090d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x16436b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.030318:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.030328:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.030335:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.030341:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938788.030345:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.030354:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.030366:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938788.030369:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938788.030374:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.030381:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938788.030401:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000138d249b reply state 00000000e33f14c5 transno 4294967557 ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47600/0xcd9d312a94a090d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x16436b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938788.030410:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938788.030489:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+208:25046:x1871643326161280:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1044us (1361us total) trans 4294967557 rc 0/0 00000100:00100000:2.0:1784938788.030496:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 351 00010000:00010000:0.0:1784938788.033788:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47600/0xcd9d312a94a090d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x16436b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.033805:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47600/0xcd9d312a94a090d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x16436b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.033813:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47600/0xcd9d312a94a090d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x16436b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.033818:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938788.033823:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47600/0xcd9d312a94a090d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x16436b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.033831:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47600/0xcd9d312a94a090d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x16436b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.033848:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x16436b8 (ffff97472ff12c00) 00010000:00010000:0.0:1784938788.033852:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938788.033856:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47600/0xcd9d312a94a090d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x16436b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.033862:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47600/0xcd9d312a94a090d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x16436b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938788.036748:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938788.037046:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326161536 00000100:00100000:0.0:1784938788.037057:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326161536 00000100:00100000:0.0:1784938788.037115:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 352 00000100:00100000:0.0:1784938788.037144:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+207:25046:x1871643326161536:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938788.037320:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.037339:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.037352:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.037368:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x13738177 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.037375:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x13738177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.037382:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x13738177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.038029:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.038039:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.038045:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.038051:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938788.038055:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.038073:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.038087:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938788.038089:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938788.038095:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.038101:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938788.038115:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071a7e5bb reply state 0000000043bbe2fb transno 4294967558 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x13738177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938788.038123:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938788.038227:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+209:25046:x1871643326161536:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1083us (1488us total) trans 4294967558 rc 0/0 00000100:00100000:0.0:1784938788.038236:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 352 00010000:00010000:0.0:1784938788.044993:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x13738177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.045011:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x13738177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.045020:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x13738177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.045026:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938788.045031:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x13738177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.045064:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x13738177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.045084:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x13738177 (ffff97460a2ef800) 00010000:00010000:0.0:1784938788.045087:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938788.045092:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x13738177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.045099:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x13738177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938788.048361:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938788.048456:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326161792 00000100:00100000:2.0:1784938788.048467:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326161792 00000100:00100000:2.0:1784938788.048531:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 353 00000100:00100000:2.0:1784938788.048541:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+208:25046:x1871643326161792:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938788.048692:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.048710:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.048722:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.048737:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a090ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x7aefd992 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.048744:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a090ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7aefd992 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.048785:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a090ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7aefd992 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.049375:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.049391:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.049398:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.049404:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938788.049408:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.049415:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.049428:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938788.049431:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938788.049436:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.049442:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a090e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938788.049456:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000025a62614 reply state 000000000fc55621 transno 4294967559 ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a090ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7aefd992 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938788.049464:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938788.049553:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+210:25046:x1871643326161792:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1013us (1200us total) trans 4294967559 rc 0/0 00000100:00100000:2.0:1784938788.049561:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 353 00010000:00010000:2.0:1784938788.054165:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a090ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7aefd992 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.054222:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a090ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7aefd992 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.054231:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a090ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7aefd992 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.054237:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938788.054242:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a090ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7aefd992 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.054250:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a090ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x7aefd992 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.054270:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x7aefd992 (ffff97472ff12f00) 00010000:00010000:2.0:1784938788.054274:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938788.054279:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a090ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x7aefd992 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.054285:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a090ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x7aefd992 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938788.054691:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938788.054800:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326162048 00000100:00100000:0.0:1784938788.054812:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326162048 00000100:00100000:0.0:1784938788.054869:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 354 00000100:00100000:0.0:1784938788.054880:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+209:25046:x1871643326162048:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938788.055051:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.055065:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.055074:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.055088:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xc39b8ecb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.055095:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc39b8ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.055117:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc39b8ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.055685:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.055693:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.055701:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.055706:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938788.055710:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.055717:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.055729:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938788.055732:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938788.055736:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.055741:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a090f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938788.055782:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d506eac0 reply state 000000009f70376c transno 4294967560 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc39b8ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938788.055791:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938788.055885:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+211:25046:x1871643326162048:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1005us (1197us total) trans 4294967560 rc 0/0 00000100:00100000:0.0:1784938788.055892:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 354 00010000:00010000:0.0:1784938788.058141:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xc39b8ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.058160:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc39b8ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.058167:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc39b8ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.058174:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938788.058179:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc39b8ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.058186:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xc39b8ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.058211:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xc39b8ecb (ffff97460a2ef800) 00010000:00010000:0.0:1784938788.058214:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938788.058226:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc39b8ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.058234:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a090fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xc39b8ecb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938788.060740:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938788.061137:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326162304 00000100:00100000:2.0:1784938788.061149:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326162304 00000100:00100000:2.0:1784938788.061221:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 355 00000100:00100000:2.0:1784938788.061232:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+210:25046:x1871643326162304:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:2.0:1784938788.061400:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a09102 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.061419:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a09102 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.061450:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a09102 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.061468:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09109 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x4e9c6b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.061475:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09109 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e9c6b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.061481:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09109 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e9c6b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.062329:0:30630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a09102 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.062339:0:30630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a09102 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.062346:0:30630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a09102 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.062353:0:30630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938788.062357:0:30630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a09102 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.062365:0:30630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a09102 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.062378:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938788.062382:0:30630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938788.062387:0:30630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a09102 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.062402:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c46200/0xcd9d312a94a09102 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938788.062417:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec125f03 reply state 00000000c616ee29 transno 4294967561 ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09109 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e9c6b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938788.062426:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938788.062517:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+212:25046:x1871643326162304:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1285us (1784us total) trans 4294967561 rc 0/0 00000100:00100000:2.0:1784938788.062525:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 355 00000100:00100000:1.0:1784938788.066399:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938788.066548:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326162560 00000100:00100000:0.0:1784938788.066559:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326162560 00000100:00100000:0.0:1784938788.066623:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 356 00000100:00100000:0.0:1784938788.066634:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+212:25046:x1871643326162560:12345-192.168.202.4@tcp:36:createmany.0 00010000:00010000:0.0:1784938788.066832:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09110 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.066848:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09110 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.066860:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09110 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.066875:0:30631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a09117 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0xec6b9be0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.066882:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a09117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xec6b9be0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.066888:0:30631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a09117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xec6b9be0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.067469:0:30631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09110 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.067479:0:30631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09110 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.067486:0:30631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09110 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.067493:0:30631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938788.067498:0:30631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09110 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.067506:0:30631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09110 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.067527:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:0.0:1784938788.067529:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938788.067534:0:30631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09110 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.067541:0:30631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0800/0xcd9d312a94a09110 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938788.067557:0:30631:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ddc812ff reply state 00000000b7899255 transno 4294967562 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a09117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xec6b9be0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938788.067565:0:30631:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938788.067651:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+214:25046:x1871643326162560:12345-192.168.202.4@tcp:36:createmany.0 Request processed in 1018us (1261us total) trans 4294967562 rc 0/0 00000100:00100000:0.0:1784938788.067659:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 356 00010000:00010000:2.0:1784938788.067777:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09109 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e9c6b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.067786:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09109 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e9c6b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.067793:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09109 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e9c6b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.067798:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938788.067801:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09109 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e9c6b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.067808:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09109 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x4e9c6b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.067817:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x4e9c6b1 (ffff97472ff12f00) 00010000:00010000:2.0:1784938788.067820:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938788.067823:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09109 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4e9c6b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938788.067841:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47000/0xcd9d312a94a09109 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x4e9c6b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.070322:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a09117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0xec6b9be0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.070340:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a09117 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xec6b9be0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.070348:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a09117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xec6b9be0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.070355:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938788.070360:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a09117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xec6b9be0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.070369:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a09117 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0xec6b9be0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.070407:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0xec6b9be0 (ffff97460a2ef800) 00010000:00010000:0.0:1784938788.070410:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938788.070416:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a09117 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xec6b9be0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938788.070422:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0000/0xcd9d312a94a09117 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0xec6b9be0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30631 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938788.149434:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938788.211175:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342562432:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938788.211602:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938788.215938:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342562432 00000100:00100000:1.0:1784938788.215957:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342562432 00000100:00100000:1.0:1784938788.216074:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 17 00000100:00100000:1.0:1784938788.216085:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:12805:x1871643342562432:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938788.216124:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 27262976 granted 102039552 pending 17039360 free 389021696 avail 386924544 00000100:00100000:1.0:1784938788.216208:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:12805:x1871643342562432:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 124us (4607us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938788.216216:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 17 00000100:00080000:1.0:1784938788.216356:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938788.216653:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342562432:192.168.202.104@tcp:13:osp-pre-0-0.0 00000001:00080000:1.0:1784938788.298792:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967328 is committed 00000001:00080000:1.0:1784938788.298823:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1784938788.298833:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967329 is committed 00000001:00080000:1.0:1784938788.298844:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00010000:00010000:3.0:1784938789.176058:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938789.534834:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938789.534935:0:30632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326162816 00000100:00100000:2.0:1784938789.534946:0:30632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326162816 00000100:00100000:2.0:1784938789.535006:0:30632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 357 00000100:00100000:2.0:1784938789.535017:0:30632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+212:25108:x1871643326162816:12345-192.168.202.4@tcp:36:chmod.0 00010000:00010000:2.0:1784938789.535080:0:30632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938789.535106:0:30632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893000/0xcd9d312a94a08aaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f78 expref: 212 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938789.535127:0:30632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff97472ff12400) 00010000:00010000:2.0:1784938789.535138:0:30632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938789.535168:0:30632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47400/0xcd9d312a94a0911e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938789.535181:0:30632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47400/0xcd9d312a94a0911e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938789.535205:0:30632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47400/0xcd9d312a94a0911e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:02000000:2.0:1784938789.535336:0:30632:0:(osd_object.c:1240:osd_attr_set()) *** cfs_fail_loc=193, val=0*** 00000004:00010000:2.0:1784938789.540490:0:30632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c4ff1fd reply state 00000000616d97c9 transno 4294967563 ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47400/0xcd9d312a94a0911e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938789.540506:0:30632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938789.542720:0:30632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+213:25108:x1871643326162816:12345-192.168.202.4@tcp:36:chmod.0 Request processed in 7690us (7882us total) trans 4294967563 rc 0/0 00000100:00100000:2.0:1784938789.542746:0:30632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 357 00000100:00100000:0.0:1784938789.553654:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938789.553702:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326162944 00000100:00100000:0.0:1784938789.553713:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326162944 00000100:00100000:0.0:1784938789.553795:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 358 00000100:00100000:0.0:1784938789.553806:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+213:25108:x1871643326162944:12345-192.168.202.4@tcp:101:chmod.0 00010000:00010000:0.0:1784938789.553833:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938789.553854:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09125 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5fd3 expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.553919:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09125 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fd3 expref: 214 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.553936:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09125 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fd3 expref: 214 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938789.554479:0:12788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47400/0xcd9d312a94a0911e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938789.554489:0:12788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47400/0xcd9d312a94a0911e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938789.554497:0:12788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47400/0xcd9d312a94a0911e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938789.554504:0:12788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938789.554509:0:12788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47400/0xcd9d312a94a0911e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938789.554519:0:12788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47400/0xcd9d312a94a0911e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938789.554534:0:12788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff97472ff12f00) 00010000:00010000:2.0:1784938789.554537:0:12788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784938789.554542:0:12788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47400/0xcd9d312a94a0911e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938789.554549:0:12788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609c47400/0xcd9d312a94a0911e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.554661:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff97472ff12f00) 00010000:00010000:0.0:1784938789.554665:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938789.554669:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460b0c1c00, rc 0) 00000100:00100000:0.0:1784938789.554784:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+213:25108:x1871643326162944:12345-192.168.202.4@tcp:101:chmod.0 Request processed in 979us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938789.554793:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 358 00000100:00100000:1.0:1784938789.563336:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938789.563413:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326163072 00000100:00100000:3.0:1784938789.563432:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326163072 00000100:00100000:3.0:1784938789.563542:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 168 00000100:00100000:3.0:1784938789.563556:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+64:10026:x1871643326163072:12345-192.168.202.4@tcp:2:chmod.0 00080000:02000000:3.0:1784938789.563828:0:33065:0:(osd_object.c:1240:osd_attr_set()) *** cfs_fail_loc=193, val=0*** 00002000:00010000:3.0:1784938789.564507:0:33065:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784938789.564513:0:33065:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1784938789.564516:0:33065:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784938789.564519:0:33065:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb ctime from disk: 0 -> 1784938789 00002000:00010000:3.0:1784938789.564523:0:33065:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1784938789.564630:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+65:10026:x1871643326163072:12345-192.168.202.4@tcp:2:chmod.0 Request processed in 1073us (1298us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1784938789.564643:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 168 00000100:00080000:1.0:1784938789.564896:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938789.609842:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938789.610312:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326163328 00000100:00100000:0.0:1784938789.610323:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326163328 00000100:00100000:0.0:1784938789.610388:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 359 00000100:00100000:0.0:1784938789.610401:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+213:25109:x1871643326163328:12345-192.168.202.4@tcp:36:chmod.0 00010000:00010000:0.0:1784938789.610454:0:30630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938789.610482:0:30630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290aa00/0xcd9d312a94a08777 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e3d expref: 213 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.610499:0:30630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff974702d24e00) 00010000:00010000:0.0:1784938789.610511:0:30630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938789.610542:0:30630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a0912c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.610556:0:30630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a0912c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.610565:0:30630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a0912c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:02000000:0.0:1784938789.610680:0:30630:0:(osd_object.c:1240:osd_attr_set()) *** cfs_fail_loc=193, val=0*** 00000004:00010000:0.0:1784938789.610909:0:30630:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005357e953 reply state 00000000da8b0acd transno 4294967564 ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a0912c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938789.610920:0:30630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938789.611039:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+214:25109:x1871643326163328:12345-192.168.202.4@tcp:36:chmod.0 Request processed in 640us (1205us total) trans 4294967564 rc 0/0 00000100:00100000:0.0:1784938789.611047:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 359 00010000:00010000:0.0:1784938789.613387:0:12789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a0912c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.613404:0:12789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a0912c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.613411:0:12789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a0912c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.613417:0:12789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1400 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:0.0:1784938789.613423:0:12789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a0912c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.613431:0:12789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a0912c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.613449:0:12789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff97460a2efc00) 00010000:00010000:0.0:1784938789.613453:0:12789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784938789.613457:0:12789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a0912c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.613463:0:12789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a0912c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938789.628113:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938789.628202:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326163456 00000100:00100000:0.0:1784938789.628223:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326163456 00000100:00100000:0.0:1784938789.628393:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 360 00000100:00100000:0.0:1784938789.628405:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+213:25109:x1871643326163456:12345-192.168.202.4@tcp:101:chmod.0 00010000:00010000:0.0:1784938789.628431:0:30631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938789.628455:0:30631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a09133 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5fda expref: -99 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.628545:0:30631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a09133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fda expref: 214 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.628562:0:30631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a09133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fda expref: 214 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938789.628585:0:30631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff97460a2efc00) 00010000:00010000:0.0:1784938789.628589:0:30631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938789.628594:0:30631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460b0c1400, rc 0) 00000100:00100000:0.0:1784938789.628677:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+214:25109:x1871643326163456:12345-192.168.202.4@tcp:101:chmod.0 Request processed in 274us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938789.628684:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 360 00000100:00100000:3.0:1784938789.641247:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938789.642338:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326163584 00000100:00100000:0.0:1784938789.642355:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326163584 00000100:00100000:0.0:1784938789.642428:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 169 00000100:00100000:0.0:1784938789.642439:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+45:10026:x1871643326163584:12345-192.168.202.4@tcp:2:chmod.0 00080000:02000000:0.0:1784938789.642582:0:31428:0:(osd_object.c:1240:osd_attr_set()) *** cfs_fail_loc=193, val=0*** 00002000:00010000:0.0:1784938789.642746:0:31428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784938789.642775:0:31428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1784938789.642777:0:31428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784938789.642780:0:31428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb ctime from disk: 0 -> 1784938790 00002000:00010000:0.0:1784938789.642782:0:31428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:3.0:1784938789.644101:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938789.644369:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+46:10026:x1871643326163584:12345-192.168.202.4@tcp:2:chmod.0 Request processed in 1924us (3125us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1784938789.644381:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 169 00010000:00010000:3.0:1784938790.198561:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938790.260087:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:12803:1871643342562688:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938790.260226:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342563200:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938790.260470:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784938790.260478:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342562560:0@lo:400:kworker.0 00000100:00100000:0.0:1784938790.260521:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938790.260551:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342563072:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938790.260583:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342562816:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938790.260608:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938790.260614:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342562944:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938790.260838:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938790.260894:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938790.260916:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938790.260937:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938790.260968:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938790.260991:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342562560 00000100:00100000:0.0:1784938790.260998:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342562560 00000100:00100000:0.0:1784938790.261045:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784938790.261054:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342562560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938790.261111:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342562560:12345-0@lo:400:kworker.0 Request processed in 57us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938790.261117:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784938790.261152:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342562816 00000100:00100000:0.0:1784938790.261155:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342562816 00000100:00100000:0.0:1784938790.261196:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342562688 00000100:00100000:3.0:1784938790.261382:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342563200 00000100:00100000:3.0:1784938790.261387:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342563200 00000100:00100000:3.0:1784938790.261419:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342562944 00000100:00100000:3.0:1784938790.261422:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342562944 00000100:00100000:3.0:1784938790.261444:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 14 00000100:00100000:3.0:1784938790.261451:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342563200:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938790.261491:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342563200:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 40us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938790.261498:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 14 00000100:00100000:3.0:1784938790.261512:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 15 00000100:00100000:3.0:1784938790.261518:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342562944:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938790.261540:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342562944:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 22us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938790.261561:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 15 00000100:00080000:3.0:1784938790.261584:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938790.261590:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938790.261593:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938790.261617:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342563072 00000100:00100000:3.0:1784938790.261621:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342563072 00000100:00100000:3.0:1784938790.261647:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 30 00000100:00100000:3.0:1784938790.261653:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342562816:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938790.261682:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342562816:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 29us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938790.261689:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 30 00000100:00100000:3.0:1784938790.261701:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 31 00000100:00100000:3.0:1784938790.261707:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342563072:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938790.261729:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342563072:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 22us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938790.261734:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 31 00000100:00080000:3.0:1784938790.261772:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938790.261969:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342562560:0@lo:400:kworker.0 00000100:00100000:3.0:1784938790.261984:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342563072:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938790.261994:0:12803:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967319 gen 2 00000100:00100000:3.0:1784938790.262009:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342563200:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938790.262535:0:12804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967319 gen 2 00000100:00100000:1.0:1784938790.262551:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342562944:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938790.262563:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342562816:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938790.262623:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342562688 00000100:00100000:0.0:1784938790.266050:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 32 00000100:00100000:0.0:1784938790.266071:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12803:x1871643342562688:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938790.266170:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12803:x1871643342562688:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 105us (5252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938790.266188:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 32 00000100:00100000:2.0:1784938790.270699:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938790.270723:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342563328:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938790.271620:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938790.271679:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:12803:1871643342562688:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938790.271742:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342563328 00000100:00100000:3.0:1784938790.271770:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342563328 00000100:00100000:3.0:1784938790.271821:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 18 00000100:00100000:3.0:1784938790.271831:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342563328:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938790.271872:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 18743296 granted 102039552 pending 17039360 free 390070272 avail 387973120 00000100:00100000:3.0:1784938790.271923:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342563328:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 93us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938790.271930:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 18 00000100:00100000:3.0:1784938790.277809:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342563328:192.168.202.104@tcp:13:osp-pre-1-0.0 00000001:00080000:1.0:1784938790.354508:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967327 is committed 00000001:00080000:1.0:1784938790.354545:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967329 is committed 00000001:00080000:1.0:1784938790.354571:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967330 is committed 00000001:00080000:1.0:1784938790.354577:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967331 is committed 00010000:00010000:1.0:1784938791.221468:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784938791.377073:0:30612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967564 is committed 00000100:00100000:3.0:1784938791.552558:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938791.552607:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938791.555048:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938791.555096:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938791.555134:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326163840 00000100:00100000:3.0:1784938791.555145:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326163840 00000100:00100000:3.0:1784938791.555238:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:3.0:1784938791.555250:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:10023:x1871643326163840:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1784938791.555330:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:10023:x1871643326163840:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938791.555338:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00080000:3.0:1784938791.555364:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938791.555842:0:30624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326163712 00000100:00100000:2.0:1784938791.555848:0:30624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326163712 00000100:00100000:2.0:1784938791.555913:0:30624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 156 00000100:00100000:2.0:1784938791.555921:0:30624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473556c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+10:10023:x1871643326163712:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1784938791.555963:0:30624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473556c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003631c3-aab2-48e6-bdb2-de6019261408+10:10023:x1871643326163712:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 42us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938791.555969:0:30624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 156 00000100:00100000:1.0:1784938791.558824:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326163968 00000100:00100000:1.0:1784938791.558843:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326163968 00000100:00100000:3.0:1784938791.559113:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326164096 00000100:00100000:3.0:1784938791.559118:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326164096 00000100:00100000:3.0:1784938791.559157:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:3.0:1784938791.559177:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+46:10025:x1871643326163968:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1784938791.559366:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:2.0:1784938791.559377:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+43:10025:x1871643326164096:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1784938791.559453:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+43:10025:x1871643326164096:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 79us (6845us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938791.559461:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:3.0:1784938791.559960:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+46:10025:x1871643326163968:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 792us (7412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938791.559968:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00080000:1.0:1784938791.560253:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938791.560259:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784938792.243310:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938793.267030:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938793.337743:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342563456:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938793.338067:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938793.338097:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342563456 00000100:00100000:0.0:1784938793.338105:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342563456 00000100:00100000:0.0:1784938793.338174:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 19 00000100:00100000:0.0:1784938793.338183:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342563456:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938793.338240:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 27262976 granted 85000192 pending 0 free 387973120 avail 385875968 00000100:00100000:0.0:1784938793.338288:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342563456:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 106us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938793.338296:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 19 00000100:00080000:0.0:1784938793.338321:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938793.338455:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974704024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342563456:192.168.202.104@tcp:13:osp-pre-0-0.0 00000001:00080000:0.0:1784938793.391423:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967330 is committed 00010000:00010000:1.0:1784938794.291062:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938794.449498:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.449552:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.449596:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.449918:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.454932:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938794.460097:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326164224 00000100:00100000:3.0:1784938794.460120:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326164224 00002000:00100000:3.0:1784938794.460257:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x19:0x0] (0->1341) req@ffff974704024000 x1871643326164224/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 1832/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.460270:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704024000 with x1871643326164224 ext(0->1341) 00002000:00010000:3.0:1784938794.460278:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974704024000 00000100:00100000:3.0:1784938794.460327:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326164480 00000100:00100000:3.0:1784938794.460331:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326164480 00002000:00100000:3.0:1784938794.460350:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (0->1752) req@ffff974704027100 x1871643326164480/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 2248/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.460358:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704027100 with x1871643326164480 ext(0->1752) 00002000:00010000:3.0:1784938794.460361:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974704027100 00000100:00100000:3.0:1784938794.460369:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326164608 00000100:00100000:3.0:1784938794.460372:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326164608 00002000:00100000:3.0:1784938794.460392:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (0->1407) req@ffff974704024e00 x1871643326164608/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 1896/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.460400:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704024e00 with x1871643326164608 ext(0->1407) 00002000:00010000:3.0:1784938794.460404:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974704024e00 00000100:00100000:3.0:1784938794.460411:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326164736 00000100:00100000:3.0:1784938794.460414:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326164736 00002000:00100000:3.0:1784938794.460427:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->854) req@ffff974704027b80 x1871643326164736/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 1344/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.460453:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704027b80 with x1871643326164736 ext(0->854) 00002000:00010000:3.0:1784938794.460457:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974704027b80 00000100:00100000:3.0:1784938794.460474:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:3.0:1784938794.460484:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+47:10024:x1871643326164224:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938794.460834:0:33062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:1.0:1784938794.460846:0:33062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+47:10026:x1871643326164480:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938794.461453:0:33062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+49:10026:x1871643326164480:12345-192.168.202.4@tcp:4:cp.0 Request processed in 606us (11896us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1784938794.461463:0:33062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 49 00002000:00100000:1.0:1784938794.461473:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1a:0x0] (0->1752) req@ffff974704027100 x1871643326164480/t4294967331(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 2248/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.461488:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704027100 with x1871643326164480 ext(0->1752) 00002000:00010000:1.0:1784938794.461493:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974704027100 00000100:00100000:1.0:1784938794.461521:0:33062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:1.0:1784938794.461529:0:33062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+43:10026:x1871643326164608:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938794.461989:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+50:10024:x1871643326164224:12345-192.168.202.4@tcp:4:cp.0 Request processed in 1503us (12506us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1784938794.461999:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 48 00002000:00100000:3.0:1784938794.462006:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x19:0x0] (0->1341) req@ffff974704024000 x1871643326164224/t4294967332(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 1832/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.462014:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704024000 with x1871643326164224 ext(0->1341) 00002000:00010000:3.0:1784938794.462019:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974704024000 00000100:00100000:3.0:1784938794.462037:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:3.0:1784938794.462046:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+49:10023:x1871643326164736:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938794.462269:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:10023:x1871643326164736:12345-192.168.202.4@tcp:4:cp.0 Request processed in 224us (12351us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1784938794.462277:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 51 00002000:00100000:3.0:1784938794.462283:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->854) req@ffff974704027b80 x1871643326164736/t4294967333(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 1344/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.462292:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704027b80 with x1871643326164736 ext(0->854) 00002000:00010000:3.0:1784938794.462297:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974704027b80 00000100:00080000:3.0:1784938794.462383:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938794.462390:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938794.463103:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.463158:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.463214:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.463232:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.463248:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.463290:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.463318:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326164864 00000100:00100000:0.0:1784938794.463328:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326164864 00002000:00100000:0.0:1784938794.463370:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1b:0x0] (0->1653) req@ffff974704024380 x1871643326164864/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 2144/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.463382:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704024380 with x1871643326164864 ext(0->1653) 00002000:00010000:0.0:1784938794.463387:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974704024380 00000100:00100000:0.0:1784938794.463399:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326165760 00000100:00100000:0.0:1784938794.463402:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326165760 00002000:00100000:0.0:1784938794.463413:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1f:0x0] (0->31710) req@ffff974704027480 x1871643326165760/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.463422:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704027480 with x1871643326165760 ext(0->31710) 00002000:00010000:0.0:1784938794.463426:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974704027480 00000100:00100000:0.0:1784938794.463431:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326164352 00000100:00100000:0.0:1784938794.463433:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326164352 00002000:00100000:0.0:1784938794.463444:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x19:0x0] (0->1658) req@ffff974704025880 x1871643326164352/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 2152/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.463451:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704025880 with x1871643326164352 ext(0->1658) 00002000:00010000:0.0:1784938794.463455:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974704025880 00000100:00100000:0.0:1784938794.463462:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326164992 00000100:00100000:0.0:1784938794.463464:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326164992 00002000:00100000:0.0:1784938794.463477:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (0->6547) req@ffff974704025180 x1871643326164992/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 7040/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.463484:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704025180 with x1871643326164992 ext(0->6547) 00002000:00010000:0.0:1784938794.463494:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974704025180 00000100:00100000:0.0:1784938794.463502:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326165120 00000100:00100000:0.0:1784938794.463505:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326165120 00002000:00100000:0.0:1784938794.463522:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1c:0x0] (0->4749) req@ffff974704027800 x1871643326165120/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 5240/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.463529:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704027800 with x1871643326165120 ext(0->4749) 00002000:00010000:0.0:1784938794.463532:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974704027800 00000100:00100000:0.0:1784938794.463539:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326165248 00000100:00100000:0.0:1784938794.463541:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326165248 00002000:00100000:0.0:1784938794.463553:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1d:0x0] (0->6820) req@ffff974704024a80 x1871643326165248/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 7312/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.463561:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704024a80 with x1871643326165248 ext(0->6820) 00002000:00010000:0.0:1784938794.463563:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974704024a80 00000100:00100000:0.0:1784938794.463570:0:31432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326166144 00000100:00100000:0.0:1784938794.463572:0:31432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326166144 00002000:00100000:0.0:1784938794.463585:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x20:0x0] (0->10933) req@ffff97473f55dc00 x1871643326166144/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 11424/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.463592:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55dc00 with x1871643326166144 ext(0->10933) 00002000:00010000:0.0:1784938794.463596:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55dc00 00000100:00100000:0.0:1784938794.463607:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:0.0:1784938794.463955:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+47:10023:x1871643326164864:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938794.464334:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:2.0:1784938794.464347:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+53:10023:x1871643326165760:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938794.465118:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+49:10023:x1871643326164864:12345-192.168.202.4@tcp:4:cp.0 Request processed in 1164us (10198us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1784938794.465131:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 52 00002000:00100000:0.0:1784938794.465151:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1b:0x0] (0->1653) req@ffff974704024380 x1871643326164864/t4294967332(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 2144/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.465171:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704024380 with x1871643326164864 ext(0->1653) 00002000:00010000:0.0:1784938794.465177:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974704024380 00000100:00100000:1.0:1784938794.465601:0:33062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+50:10026:x1871643326164608:12345-192.168.202.4@tcp:4:cp.0 Request processed in 4070us (16001us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1784938794.468110:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:1.0:1784938794.468282:0:33062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 50 00002000:00100000:1.0:1784938794.468305:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1a:0x0] (0->1407) req@ffff974704024e00 x1871643326164608/t4294967333(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 1896/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.468319:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704024e00 with x1871643326164608 ext(0->1407) 00002000:00010000:1.0:1784938794.468327:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974704024e00 00000100:00100000:1.0:1784938794.468373:0:33062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:1.0:1784938794.468385:0:33062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+54:10026:x1871643326164992:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938794.468894:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938794.469485:0:33062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:10026:x1871643326164992:12345-192.168.202.4@tcp:4:cp.0 Request processed in 1101us (6274us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1784938794.469498:0:33062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 55 00002000:00100000:1.0:1784938794.469510:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1c:0x0] (0->6547) req@ffff974704025180 x1871643326164992/t4294967334(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 7040/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.469520:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704025180 with x1871643326164992 ext(0->6547) 00002000:00010000:1.0:1784938794.469526:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974704025180 00000100:00100000:0.0:1784938794.469958:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938794.470290:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326166272 00000100:00100000:1.0:1784938794.470303:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326166272 00002000:00100000:1.0:1784938794.470363:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x21:0x0] (0->227515) req@ffff97473f55ca80 x1871643326166272/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.470373:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55ca80 with x1871643326166272 ext(0->227515) 00002000:00010000:1.0:1784938794.470378:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55ca80 00000100:00100000:3.0:1784938794.473906:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10023:x1871643326165760:12345-192.168.202.4@tcp:4:cp.0 Request processed in 9544us (10789us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1784938794.473937:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 53 00002000:00100000:3.0:1784938794.473958:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1f:0x0] (0->31710) req@ffff974704027480 x1871643326165760/t4294967335(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.473970:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704027480 with x1871643326165760 ext(0->31710) 00002000:00010000:3.0:1784938794.473979:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974704027480 00000100:00100000:0.0:1784938794.476258:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938794.478031:0:31433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326165376 00000100:00100000:3.0:1784938794.478052:0:31433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326165376 00002000:00100000:3.0:1784938794.478132:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (0->116977) req@ffff97473f55f480 x1871643326165376/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.478155:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55f480 with x1871643326165376 ext(0->116977) 00002000:00010000:3.0:1784938794.478163:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55f480 00000100:00100000:3.0:1784938794.478344:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:3.0:1784938794.478357:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+50:10026:x1871643326165120:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938794.482512:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+52:10026:x1871643326165120:12345-192.168.202.4@tcp:4:cp.0 Request processed in 4141us (19261us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1784938794.482529:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 56 00002000:00100000:3.0:1784938794.482547:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1c:0x0] (0->4749) req@ffff974704027800 x1871643326165120/t4294967334(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 5240/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.482558:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704027800 with x1871643326165120 ext(0->4749) 00002000:00010000:3.0:1784938794.482565:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974704027800 00000100:00100000:3.0:1784938794.482609:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:3.0:1784938794.482791:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+56:10023:x1871643326165248:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938794.483403:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:2.0:1784938794.483417:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+51:10025:x1871643326166144:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938794.483824:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+53:10025:x1871643326166144:12345-192.168.202.4@tcp:4:cp.0 Request processed in 408us (20530us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1784938794.483833:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 58 00002000:00100000:2.0:1784938794.483842:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x20:0x0] (0->10933) req@ffff97473f55dc00 x1871643326166144/t4294967335(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 11424/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938794.483853:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55dc00 with x1871643326166144 ext(0->10933) 00002000:00010000:2.0:1784938794.483859:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55dc00 00000100:00100000:2.0:1784938794.483880:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:2.0:1784938794.483888:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10023:x1871643326166272:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938794.484695:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:10023:x1871643326165248:12345-192.168.202.4@tcp:4:cp.0 Request processed in 1906us (21438us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1784938794.484723:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 57 00002000:00100000:3.0:1784938794.484733:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1d:0x0] (0->6820) req@ffff974704024a80 x1871643326165248/t4294967336(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 7312/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.484741:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704024a80 with x1871643326165248 ext(0->6820) 00002000:00010000:3.0:1784938794.484746:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974704024a80 00000100:00100000:3.0:1784938794.484789:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:3.0:1784938794.484800:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+52:10023:x1871643326165376:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938794.486295:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.486314:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.486326:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.486338:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.486350:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.486393:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.486411:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.486473:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938794.486791:0:33062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1784938794.486803:0:33062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1784938794.487061:0:33067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784938794.487075:0:33067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326165888 00000100:00100000:1.0:1784938794.487086:0:33067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326165888 00002000:00100000:1.0:1784938794.487158:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1f:0x0] (0->215292) req@ffff97473f55d500 x1871643326165888/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.487178:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55d500 with x1871643326165888 ext(0->215292) 00002000:00010000:1.0:1784938794.487184:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55d500 00000100:00100000:1.0:1784938794.487203:0:33067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784938794.487313:0:33067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326166400 00000100:00100000:1.0:1784938794.487317:0:33067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326166400 00002000:00100000:1.0:1784938794.487335:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (0->159677) req@ffff97473f55fb80 x1871643326166400/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.487343:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55fb80 with x1871643326166400 ext(0->159677) 00002000:00010000:1.0:1784938794.487347:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55fb80 00000100:00100000:1.0:1784938794.487356:0:33067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784938794.487362:0:33067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326165504 00000100:00100000:1.0:1784938794.487365:0:33067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326165504 00002000:00100000:1.0:1784938794.487379:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1e:0x0] (0->143466) req@ffff97473f55e300 x1871643326165504/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.487387:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55e300 with x1871643326165504 ext(0->143466) 00002000:00010000:1.0:1784938794.487391:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55e300 00000100:00100000:1.0:1784938794.487399:0:33067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784938794.487403:0:33067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326166016 00000100:00100000:1.0:1784938794.487420:0:33067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326166016 00002000:00100000:1.0:1784938794.487436:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x20:0x0] (0->198049) req@ffff97473f55c700 x1871643326166016/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.487443:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55c700 with x1871643326166016 ext(0->198049) 00002000:00010000:1.0:1784938794.487448:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55c700 00000100:00100000:1.0:1784938794.487457:0:33067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784938794.487462:0:33067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326165632 00000100:00100000:1.0:1784938794.487465:0:33067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326165632 00002000:00100000:1.0:1784938794.487480:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1e:0x0] (0->170594) req@ffff97473f55f100 x1871643326165632/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.487487:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55f100 with x1871643326165632 ext(0->170594) 00002000:00010000:1.0:1784938794.487490:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55f100 00000100:00100000:1.0:1784938794.487497:0:33067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784938794.487503:0:33067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326166656 00000100:00100000:1.0:1784938794.487505:0:33067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326166656 00002000:00100000:1.0:1784938794.487518:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x24:0x0] (0->26715) req@ffff97473f55e680 x1871643326166656/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.487525:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55e680 with x1871643326166656 ext(0->26715) 00002000:00010000:1.0:1784938794.487529:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55e680 00000100:00100000:1.0:1784938794.487537:0:33067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784938794.487542:0:33067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326166528 00000100:00100000:1.0:1784938794.487545:0:33067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326166528 00002000:00100000:1.0:1784938794.487558:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x26:0x0] (0->24287) req@ffff97473f55df80 x1871643326166528/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.487565:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55df80 with x1871643326166528 ext(0->24287) 00002000:00010000:1.0:1784938794.487568:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55df80 00000100:00100000:1.0:1784938794.487575:0:33067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784938794.487589:0:33067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326166784 00000100:00100000:1.0:1784938794.487593:0:33067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326166784 00002000:00100000:1.0:1784938794.487608:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x27:0x0] (0->1764) req@ffff97473f55ea00 x1871643326166784/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 2256/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.488049:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55ea00 with x1871643326166784 ext(0->1764) 00002000:00010000:1.0:1784938794.488053:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55ea00 00000100:00100000:1.0:1784938794.488067:0:33067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784938794.488076:0:33067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326166912 00000100:00100000:1.0:1784938794.488080:0:33067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326166912 00002000:00100000:1.0:1784938794.488100:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x25:0x0] (0->2474) req@ffff97473f55c000 x1871643326166912/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 2968/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.488107:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55c000 with x1871643326166912 ext(0->2474) 00002000:00010000:1.0:1784938794.488111:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55c000 00000100:00100000:2.0:1784938794.490748:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+57:10024:x1871643326164352:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938794.500105:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+59:10024:x1871643326164352:12345-192.168.202.4@tcp:4:cp.0 Request processed in 31961us (36928us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1784938794.500125:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 54 00002000:00100000:2.0:1784938794.500156:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x19:0x0] (0->1658) req@ffff974704025880 x1871643326164352/t4294967336(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 2152/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938794.500169:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974704025880 with x1871643326164352 ext(0->1658) 00002000:00010000:2.0:1784938794.500180:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974704025880 00000100:00100000:2.0:1784938794.500220:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:2.0:1784938794.500234:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10023:x1871643326165888:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938794.501807:0:33169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:3.0:1784938794.501831:0:33169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10023:x1871643326166400:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938794.502645:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.502793:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.503003:0:33062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:0.0:1784938794.503014:0:33062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:0.0:1784938794.503166:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326167040 00000100:00100000:0.0:1784938794.503177:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326167040 00002000:00100000:0.0:1784938794.503234:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x26:0x0] (0->1610) req@ffff9746047bc380 x1871643326167040/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 2104/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.503247:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bc380 with x1871643326167040 ext(0->1610) 00002000:00010000:0.0:1784938794.503255:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746047bc380 00000100:00100000:0.0:1784938794.503277:0:33062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:0.0:1784938794.503284:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326167168 00000100:00100000:0.0:1784938794.503287:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326167168 00002000:00100000:0.0:1784938794.503321:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x25:0x0] (0->5104) req@ffff9746047bd880 x1871643326167168/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 5600/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.503329:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bd880 with x1871643326167168 ext(0->5104) 00002000:00010000:0.0:1784938794.503333:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9746047bd880 00000100:00100000:0.0:1784938794.504291:0:33170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:0.0:1784938794.504308:0:33170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+64:10025:x1871643326165504:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938794.508995:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938794.509192:0:33062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 7 min 3 max 116 00000100:00100000:2.0:1784938794.509205:0:33062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_007' 00000100:00100000:2.0:1784938794.509357:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326167296 00000100:00100000:2.0:1784938794.509369:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326167296 00002000:00100000:2.0:1784938794.509424:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x23:0x0] (0->42516) req@ffff974603681180 x1871643326167296/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938794.509437:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974603681180 with x1871643326167296 ext(0->42516) 00002000:00010000:2.0:1784938794.509444:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974603681180 00000100:00100000:2.0:1784938794.510325:0:33171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:2.0:1784938794.510342:0:33171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+66:10025:x1871643326166016:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938794.512614:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+68:10023:x1871643326166272:12345-192.168.202.4@tcp:4:cp.0 Request processed in 28710us (44393us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1784938794.512632:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 59 00002000:00100000:2.0:1784938794.512664:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x21:0x0] (0->227515) req@ffff97473f55ca80 x1871643326166272/t4294967337(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938794.512676:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55ca80 with x1871643326166272 ext(0->227515) 00002000:00010000:2.0:1784938794.512686:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55ca80 00000100:00100000:2.0:1784938794.512728:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:2.0:1784938794.512740:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+61:10025:x1871643326165632:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:2.0:1784938794.513820:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938794.513973:0:33062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 8 min 3 max 116 00000100:00100000:3.0:1784938794.513993:0:33062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_008' 00000100:00100000:3.0:1784938794.515253:0:33062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326167424 00000100:00100000:3.0:1784938794.515268:0:33062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326167424 00002000:00100000:3.0:1784938794.515351:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x22:0x0] (0->88086) req@ffff97460b0fc700 x1871643326167424/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.515363:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97460b0fc700 with x1871643326167424 ext(0->88086) 00002000:00010000:3.0:1784938794.515381:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97460b0fc700 00000100:00100000:2.0:1784938794.523260:0:33172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:2.0:1784938794.523284:0:33172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+68:10026:x1871643326166656:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938794.523611:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.523652:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.523701:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938794.523718:0:33067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 9 min 3 max 116 00000100:00100000:1.0:1784938794.523743:0:33067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_009' 00000100:00100000:0.0:1784938794.524645:0:33067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326167552 00000100:00100000:0.0:1784938794.524656:0:33067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326167552 00002000:00100000:0.0:1784938794.524722:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x27:0x0] (0->316747) req@ffff9746047bf800 x1871643326167552/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.524734:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bf800 with x1871643326167552 ext(0->316747) 00002000:00010000:0.0:1784938794.524740:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746047bf800 00000100:00100000:0.0:1784938794.524785:0:33067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 9 min 3 max 116 00000100:00100000:0.0:1784938794.524792:0:33067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326167680 00000100:00100000:0.0:1784938794.524796:0:33067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326167680 00000100:00100000:1.0:1784938794.525124:0:33173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326167808 00000100:00100000:1.0:1784938794.525130:0:33173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326167808 00002000:00100000:1.0:1784938794.525160:0:33173:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x23:0x0] (0->429669) req@ffff9746047bd500 x1871643326167808/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.525169:0:33173:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bd500 with x1871643326167808 ext(0->429669) 00002000:00010000:1.0:1784938794.525173:0:33173:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746047bd500 00000100:00100000:1.0:1784938794.525187:0:33173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:1.0:1784938794.525196:0:33173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+69:10026:x1871643326166528:12345-192.168.202.4@tcp:4:cp.0 00002000:00100000:0.0:1784938794.526299:0:33067:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (0->254128) req@ffff9746047bdf80 x1871643326167680/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.526311:0:33067:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bdf80 with x1871643326167680 ext(0->254128) 00002000:00010000:0.0:1784938794.526316:0:33067:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746047bdf80 00000100:00100000:0.0:1784938794.531510:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+66:10023:x1871643326165376:12345-192.168.202.4@tcp:4:cp.0 Request processed in 46699us (61539us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1784938794.531526:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 60 00002000:00100000:0.0:1784938794.531542:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (0->116977) req@ffff97473f55f480 x1871643326165376/t4294967337(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.531566:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55f480 with x1871643326165376 ext(0->116977) 00002000:00010000:0.0:1784938794.531574:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55f480 00000100:00100000:0.0:1784938794.531618:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:0.0:1784938794.531630:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+70:10024:x1871643326166784:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938794.533748:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+72:10024:x1871643326166784:12345-192.168.202.4@tcp:4:cp.0 Request processed in 2111us (47325us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1784938794.533784:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 68 00002000:00100000:0.0:1784938794.533799:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x27:0x0] (0->1764) req@ffff97473f55ea00 x1871643326166784/t4294967338(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 2256/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.533809:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55ea00 with x1871643326166784 ext(0->1764) 00002000:00010000:0.0:1784938794.533815:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55ea00 00000100:00100000:0.0:1784938794.533848:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:0.0:1784938794.533861:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473f55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+65:10024:x1871643326166912:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938794.535563:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+67:10024:x1871643326166912:12345-192.168.202.4@tcp:4:cp.0 Request processed in 1697us (49080us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1784938794.535575:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 69 00002000:00100000:0.0:1784938794.535586:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x25:0x0] (0->2474) req@ffff97473f55c000 x1871643326166912/t4294967338(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 2968/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.535596:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55c000 with x1871643326166912 ext(0->2474) 00002000:00010000:0.0:1784938794.535602:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55c000 00000100:00100000:0.0:1784938794.535631:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:0.0:1784938794.535641:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+66:10025:x1871643326167040:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938794.538510:0:33170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+72:10025:x1871643326165504:12345-192.168.202.4@tcp:4:cp.0 Request processed in 34190us (52177us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1784938794.538524:0:33170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 63 00002000:00100000:1.0:1784938794.538556:0:33170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x1e:0x0] (0->143466) req@ffff97473f55e300 x1871643326165504/t4294967339(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.538565:0:33170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55e300 with x1871643326165504 ext(0->143466) 00002000:00010000:1.0:1784938794.538572:0:33170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55e300 00000100:00100000:1.0:1784938794.538612:0:33170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:1.0:1784938794.539105:0:33170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+71:10025:x1871643326167168:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938794.541197:0:33170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+73:10025:x1871643326167168:12345-192.168.202.4@tcp:4:cp.0 Request processed in 2568us (38394us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1784938794.541210:0:33170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 71 00002000:00100000:1.0:1784938794.541223:0:33170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x25:0x0] (0->5104) req@ffff9746047bd880 x1871643326167168/t4294967340(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 5600/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.541232:0:33170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bd880 with x1871643326167168 ext(0->5104) 00002000:00010000:1.0:1784938794.541238:0:33170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9746047bd880 00000100:00100000:0.0:1784938794.541248:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+68:10025:x1871643326167040:12345-192.168.202.4@tcp:4:cp.0 Request processed in 5606us (38605us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1784938794.541258:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 70 00002000:00100000:0.0:1784938794.541266:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x26:0x0] (0->1610) req@ffff9746047bc380 x1871643326167040/t4294967339(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 2104/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.541276:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bc380 with x1871643326167040 ext(0->1610) 00002000:00010000:0.0:1784938794.541281:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746047bc380 00000100:00100000:1.0:1784938794.541293:0:33170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:0.0:1784938794.541307:0:31433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:1.0:1784938794.541309:0:33170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+72:10024:x1871643326167296:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938794.541320:0:31433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+72:10024:x1871643326167424:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938794.555584:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938794.557427:0:33067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 10 min 3 max 116 00000100:00100000:1.0:1784938794.557444:0:33067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_010' 00000100:00100000:1.0:1784938794.558425:0:33171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+75:10025:x1871643326166016:12345-192.168.202.4@tcp:4:cp.0 Request processed in 48078us (72087us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1784938794.558439:0:33171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 64 00002000:00100000:1.0:1784938794.558455:0:33171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x20:0x0] (0->198049) req@ffff97473f55c700 x1871643326166016/t4294967341(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.558466:0:33171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55c700 with x1871643326166016 ext(0->198049) 00002000:00010000:1.0:1784938794.558473:0:33171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55c700 00000100:00100000:1.0:1784938794.558512:0:33171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326168064 00000100:00100000:1.0:1784938794.558519:0:33171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326168064 00002000:00100000:1.0:1784938794.558552:0:33171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x24:0x0] (1048576->1179442) req@ffff9746047bce00 x1871643326168064/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.558562:0:33171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bce00 with x1871643326168064 ext(1048576->1179442) 00002000:00010000:1.0:1784938794.558566:0:33171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746047bce00 00000100:00100000:1.0:1784938794.558607:0:33062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00100000:1.0:1784938794.558616:0:33062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+68:10025:x1871643326167552:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:1.0:1784938794.559915:0:33174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:1.0:1784938794.559929:0:33174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+69:10024:x1871643326167808:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938794.573271:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+71:10023:x1871643326165888:12345-192.168.202.4@tcp:4:cp.0 Request processed in 73028us (97013us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1784938794.573288:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00002000:00100000:0.0:1784938794.573723:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1f:0x0] (0->215292) req@ffff97473f55d500 x1871643326165888/t4294967340(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.573734:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55d500 with x1871643326165888 ext(0->215292) 00002000:00010000:0.0:1784938794.573742:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55d500 00000100:00100000:0.0:1784938794.573800:0:31432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:0.0:1784938794.574018:0:31432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+70:10025:x1871643326167680:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:3.0:1784938794.577653:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+72:10025:x1871643326165632:12345-192.168.202.4@tcp:4:cp.0 Request processed in 64901us (91298us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1784938794.577669:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 65 00002000:00100000:3.0:1784938794.577682:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1e:0x0] (0->170594) req@ffff97473f55f100 x1871643326165632/t4294967341(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.577703:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55f100 with x1871643326165632 ext(0->170594) 00002000:00010000:3.0:1784938794.577710:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55f100 00000100:00100000:3.0:1784938794.577745:0:31431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:3.0:1784938794.577779:0:31431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+71:10026:x1871643326168064:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938794.580805:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938794.582562:0:33170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+75:10024:x1871643326167296:12345-192.168.202.4@tcp:4:cp.0 Request processed in 41251us (73574us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1784938794.582576:0:33170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 72 00002000:00100000:0.0:1784938794.582600:0:33170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x23:0x0] (0->42516) req@ffff974603681180 x1871643326167296/t4294967342(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.582610:0:33170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974603681180 with x1871643326167296 ext(0->42516) 00002000:00010000:0.0:1784938794.582617:0:33170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974603681180 00000100:00100000:0.0:1784938794.582645:0:33170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326167936 00000100:00100000:0.0:1784938794.582653:0:33170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326167936 00002000:00100000:0.0:1784938794.582685:0:33170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x28:0x0] (0->4511) req@ffff9746047bdc00 x1871643326167936/t0(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 5000/0 e 0 to 0 dl 1784938805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.582692:0:33170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bdc00 with x1871643326167936 ext(0->4511) 00002000:00010000:0.0:1784938794.582696:0:33170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9746047bdc00 00000100:00100000:0.0:1784938794.582720:0:33170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:0.0:1784938794.582729:0:33170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+75:10023:x1871643326167936:12345-192.168.202.4@tcp:4:cp.0 00000100:00100000:0.0:1784938794.583792:0:33170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+77:10023:x1871643326167936:12345-192.168.202.4@tcp:4:cp.0 Request processed in 1058us (2990us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1784938794.583800:0:33170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 78 00002000:00100000:0.0:1784938794.583809:0:33170:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x28:0x0] (0->4511) req@ffff9746047bdc00 x1871643326167936/t4294967343(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 5000/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.583817:0:33170:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bdc00 with x1871643326167936 ext(0->4511) 00002000:00010000:0.0:1784938794.583821:0:33170:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9746047bdc00 00000100:00100000:3.0:1784938794.588167:0:33172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+80:10026:x1871643326166656:12345-192.168.202.4@tcp:4:cp.0 Request processed in 63467us (100389us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1784938794.588891:0:33173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+79:10026:x1871643326166528:12345-192.168.202.4@tcp:4:cp.0 Request processed in 63687us (102488us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1784938794.588905:0:33173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 67 00002000:00100000:1.0:1784938794.588917:0:33173:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x26:0x0] (0->24287) req@ffff97473f55df80 x1871643326166528/t4294967344(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.588928:0:33173:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55df80 with x1871643326166528 ext(0->24287) 00002000:00010000:1.0:1784938794.588935:0:33173:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55df80 00000100:00100000:3.0:1784938794.589246:0:33172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 66 00002000:00100000:3.0:1784938794.589257:0:33172:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x24:0x0] (0->26715) req@ffff97473f55e680 x1871643326166656/t4294967345(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.589266:0:33172:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55e680 with x1871643326166656 ext(0->26715) 00002000:00010000:3.0:1784938794.589271:0:33172:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97473f55e680 00000100:00100000:2.0:1784938794.589663:0:31433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+77:10024:x1871643326167424:12345-192.168.202.4@tcp:4:cp.0 Request processed in 48344us (75849us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1784938794.589673:0:31433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 73 00002000:00100000:2.0:1784938794.589681:0:31433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (0->88086) req@ffff97460b0fc700 x1871643326167424/t4294967346(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938794.589691:0:31433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97460b0fc700 with x1871643326167424 ext(0->88086) 00002000:00010000:2.0:1784938794.589696:0:31433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97460b0fc700 00000100:00100000:0.0:1784938794.590405:0:33062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+73:10025:x1871643326167552:12345-192.168.202.4@tcp:4:cp.0 Request processed in 31449us (66455us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1784938794.590417:0:33062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 74 00002000:00100000:0.0:1784938794.590426:0:33062:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x27:0x0] (0->316747) req@ffff9746047bf800 x1871643326167552/t4294967342(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.590452:0:33062:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bf800 with x1871643326167552 ext(0->316747) 00002000:00010000:0.0:1784938794.590457:0:33062:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746047bf800 00000100:00100000:1.0:1784938794.594389:0:33169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+73:10023:x1871643326166400:12345-192.168.202.4@tcp:4:cp.0 Request processed in 92555us (108092us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1784938794.594405:0:33169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 62 00002000:00100000:1.0:1784938794.594420:0:33169:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x21:0x0] (0->159677) req@ffff97473f55fb80 x1871643326166400/t4294967343(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938794.594431:0:33169:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97473f55fb80 with x1871643326166400 ext(0->159677) 00002000:00010000:1.0:1784938794.594438:0:33169:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97473f55fb80 00000100:00100000:0.0:1784938794.609975:0:33174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+73:10024:x1871643326167808:12345-192.168.202.4@tcp:4:cp.0 Request processed in 50035us (86259us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1784938794.609990:0:33174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00002000:00100000:0.0:1784938794.610006:0:33174:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x23:0x0] (0->429669) req@ffff9746047bd500 x1871643326167808/t4294967344(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938794.610028:0:33174:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bd500 with x1871643326167808 ext(0->429669) 00002000:00010000:0.0:1784938794.610036:0:33174:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746047bd500 00000100:00100000:3.0:1784938794.610694:0:31432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+73:10025:x1871643326167680:12345-192.168.202.4@tcp:4:cp.0 Request processed in 36881us (87037us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1784938794.610704:0:31432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 76 00002000:00100000:3.0:1784938794.610711:0:31432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (0->254128) req@ffff9746047bdf80 x1871643326167680/t4294967345(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938794.610720:0:31432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bdf80 with x1871643326167680 ext(0->254128) 00002000:00010000:3.0:1784938794.610725:0:31432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746047bdf80 00000100:00100000:2.0:1784938794.611169:0:31431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+73:10026:x1871643326168064:12345-192.168.202.4@tcp:4:cp.0 Request processed in 33413us (55594us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1784938794.611178:0:31431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 77 00002000:00100000:2.0:1784938794.611185:0:31431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x24:0x0] (1048576->1179442) req@ffff9746047bce00 x1871643326168064/t4294967346(0) o4->5ec7c535-1b11-4e0e-8d43-d37b8591d8b1@192.168.202.4@tcp:270/0 lens 488/448 e 0 to 0 dl 1784938805 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938794.611194:0:31431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9746047bce00 with x1871643326168064 ext(1048576->1179442) 00002000:00010000:2.0:1784938794.611199:0:31431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9746047bce00 00000100:00100000:2.0:1784938794.679348:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938794.679392:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938794.679438:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938794.679703:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326168448 00000100:00100000:1.0:1784938794.679719:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326168448 00000100:00100000:0.0:1784938794.679807:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326168320 00000100:00100000:0.0:1784938794.679817:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326168320 00000100:00100000:1.0:1784938794.679847:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326168192 00000100:00100000:1.0:1784938794.679854:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326168192 00000100:00100000:0.0:1784938794.679885:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:0.0:1784938794.679952:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:003631c3-aab2-48e6-bdb2-de6019261408+12:10024:x1871643326168448:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938794.679975:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938794.680002:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974735f29a00/0xcd9d312a94a07510 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d572f expref: 12 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938794.680024:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938794.680100:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:003631c3-aab2-48e6-bdb2-de6019261408+11:10024:x1871643326168448:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 204us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938794.688653:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:0.0:1784938794.688722:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:0.0:1784938794.688899:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:003631c3-aab2-48e6-bdb2-de6019261408+10:10024:x1871643326168320:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938794.688988:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938794.689042:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974735f28000/0xcd9d312a94a06e79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54b2 expref: 10 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938794.689064:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938794.689171:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:003631c3-aab2-48e6-bdb2-de6019261408+9:10024:x1871643326168320:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 439us (9778us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938794.689180:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:0.0:1784938794.689200:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:0.0:1784938794.689292:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:003631c3-aab2-48e6-bdb2-de6019261408+8:10025:x1871643326168192:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938794.689302:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938794.689313:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974735f28400/0xcd9d312a94a06e72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5488 expref: 8 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938794.689322:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938794.689344:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:003631c3-aab2-48e6-bdb2-de6019261408+7:10025:x1871643326168192:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 60us (9907us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938794.689351:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:2.0:1784938794.703450:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938794.704357:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326173440 00000100:00100000:3.0:1784938794.704374:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326173440 00000100:00100000:3.0:1784938794.704469:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 170 00000100:00100000:3.0:1784938794.704480:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+73:10022:x1871643326173440:12345-192.168.202.4@tcp:9:umount.0 00000020:00000080:3.0:1784938794.704536:0:31427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06e95 00000020:00010000:3.0:1784938794.704568:0:31427:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97473b75b800: total 0 00000100:00080000:3.0:1784938794.704582:0:31427:0:(import.c:65:import_set_state_nolock()) ffff97473b75e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784938794.704653:0:31427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967346 00000020:00010000:0.0:1784938794.704784:0:31441:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97473b75b800: total 0 00010000:00010000:0.0:1784938794.704799:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938794.704846:0:31441:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97473b75b800, canceled 0 locks, left on hash table 38. 00002000:00010000:0.0:1784938794.704895:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size from disk: 0 -> 159678 00002000:00010000:0.0:1784938794.704899:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime from disk: 0 -> 1784938785 00002000:00010000:0.0:1784938794.704902:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime from disk: 0 -> 1784938785 00010000:00010000:0.0:1784938794.704939:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0867b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5de2 expref: 72 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.704978:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb size from disk: 0 -> 16001 00002000:00010000:0.0:1784938794.704981:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:0.0:1784938794.704991:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:0.0:1784938794.704993:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb blocks from disk: 1 -> 35 00010000:00010000:0.0:1784938794.705006:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba2a2a0e/0xcd9d312a94a07621 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5798 expref: 71 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705031:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 0 -> 1659 00002000:00010000:0.0:1784938794.705035:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:0.0:1784938794.705037:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb ctime from disk: 0 -> 1784938784 00010000:00010000:0.0:1784938794.705046:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6124ba5/0xcd9d312a94a080cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bb2 expref: 70 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705069:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 0 -> 4750 00002000:00010000:0.0:1784938794.705072:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb mtime from disk: 0 -> 1784938785 00002000:00010000:0.0:1784938794.705074:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb ctime from disk: 0 -> 1784938785 00010000:00010000:0.0:1784938794.705083:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a082ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c84 expref: 69 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705105:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb size from disk: 0 -> 6430 00002000:00010000:0.0:1784938794.705107:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:0.0:1784938794.705109:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb ctime from disk: 0 -> 1784938784 00002000:00010000:0.0:1784938794.705111:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb blocks from disk: 1 -> 19 00010000:00010000:0.0:1784938794.705119:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fdad413/0xcd9d312a94a07d3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a54 expref: 68 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705138:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 9198 00002000:00010000:0.0:1784938794.705151:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:0.0:1784938794.705153:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:0.0:1784938794.705161:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 35 00010000:00010000:0.0:1784938794.705173:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058776656/0xcd9d312a94a07342 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5679 expref: 67 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705193:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb size from disk: 0 -> 158096 00002000:00010000:0.0:1784938794.705196:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:0.0:1784938794.705198:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb ctime from disk: 0 -> 1784938784 00002000:00010000:0.0:1784938794.705200:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb blocks from disk: 1 -> 515 00010000:00010000:0.0:1784938794.705208:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c8a06ac/0xcd9d312a94a07f5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->159743) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b26 expref: 66 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705227:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb size from disk: 0 -> 1611 00002000:00010000:0.0:1784938794.705229:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb mtime from disk: 0 -> 1784938787 00002000:00010000:0.0:1784938794.705231:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x26:0x0] updating lvb ctime from disk: 0 -> 1784938787 00010000:00010000:0.0:1784938794.705239:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008df3548c/0xcd9d312a94a08a09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f40 expref: 65 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705257:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb size from disk: 0 -> 6213 00002000:00010000:0.0:1784938794.705259:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:0.0:1784938794.705261:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:0.0:1784938794.705263:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb blocks from disk: 1 -> 19 00010000:00010000:0.0:1784938794.705269:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bacfa4a0/0xcd9d312a94a079af lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58f6 expref: 64 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705287:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb size from disk: 0 -> 170595 00002000:00010000:0.0:1784938794.705290:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 1784938785 00002000:00010000:0.0:1784938794.705291:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 1784938785 00010000:00010000:0.0:1784938794.705308:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3195ec7/0xcd9d312a94a08459 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->172031) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d10 expref: 64 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705329:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size from disk: 0 -> 13879 00002000:00010000:0.0:1784938794.705332:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:0.0:1784938794.705334:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime from disk: 0 -> 1784938784 00002000:00010000:0.0:1784938794.705336:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 1 -> 35 00010000:00010000:0.0:1784938794.705343:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c39359a/0xcd9d312a94a07ea9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ae0 expref: 61 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705359:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 704 00002000:00010000:0.0:1784938794.705362:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:0.0:1784938794.705364:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:0.0:1784938794.705365:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1784938794.705372:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8733c47/0xcd9d312a94a074ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5705 expref: 60 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705386:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb size from disk: 0 -> 2475 00002000:00010000:0.0:1784938794.705389:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb mtime from disk: 0 -> 1784938786 00002000:00010000:0.0:1784938794.705391:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x25:0x0] updating lvb ctime from disk: 0 -> 1784938786 00010000:00010000:0.0:1784938794.705397:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a08953 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5efa expref: 59 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705415:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb size from disk: 0 -> 3079 00002000:00010000:0.0:1784938794.705417:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:0.0:1784938794.705420:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb ctime from disk: 0 -> 1784938783 00000100:00100000:3.0:1784938794.705422:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+58:10022:x1871643326173440:12345-192.168.202.4@tcp:9:umount.0 Request processed in 943us (1994us total) trans 0 rc 0/0 00002000:00010000:0.0:1784938794.705422:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1784938794.705432:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 170 00010000:00010000:0.0:1784938794.705437:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d1f0eb5/0xcd9d312a94a07b1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5982 expref: 58 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705457:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 1735 00002000:00010000:0.0:1784938794.705459:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784938781 00002000:00010000:0.0:1784938794.705461:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1784938781 00002000:00010000:0.0:1784938794.705463:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1784938794.705472:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000066307fb/0xcd9d312a94a070f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55a7 expref: 56 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705490:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb size from disk: 0 -> 10934 00002000:00010000:0.0:1784938794.705493:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb mtime from disk: 0 -> 1784938785 00002000:00010000:0.0:1784938794.705495:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb ctime from disk: 0 -> 1784938785 00010000:00010000:0.0:1784938794.705502:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5f095b6/0xcd9d312a94a085c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d9c expref: 55 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705520:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 0 -> 429670 00002000:00010000:0.0:1784938794.705523:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 0 -> 1784938786 00002000:00010000:0.0:1784938794.705526:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 0 -> 1784938786 00010000:00010000:0.0:1784938794.705533:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a087e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->430079) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e6e expref: 54 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705551:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb size from disk: 0 -> 4218 00002000:00010000:0.0:1784938794.705553:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:0.0:1784938794.705555:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:0.0:1784938794.705557:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb blocks from disk: 1 -> 19 00010000:00010000:0.0:1784938794.705564:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbfde065/0xcd9d312a94a0778d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5824 expref: 53 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705593:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb size from disk: 0 -> 1654 00002000:00010000:0.0:1784938794.705596:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb mtime from disk: 0 -> 1784938785 00002000:00010000:0.0:1784938794.705599:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb ctime from disk: 0 -> 1784938785 00010000:00010000:0.0:1784938794.705609:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002edb92e1/0xcd9d312a94a08237 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c3e expref: 52 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705629:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xe:0x0] updating lvb size from disk: 0 -> 55540 00002000:00010000:0.0:1784938794.705632:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xe:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:0.0:1784938794.705634:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xe:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:0.0:1784938794.705636:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xe:0x0] updating lvb blocks from disk: 1 -> 131 00010000:00010000:0.0:1784938794.705646:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b10ee71a/0xcd9d312a94a078f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->57343) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58b0 expref: 51 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705665:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb size from disk: 0 -> 116978 00002000:00010000:0.0:1784938794.705668:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb mtime from disk: 0 -> 1784938785 00002000:00010000:0.0:1784938794.705670:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb ctime from disk: 0 -> 1784938785 00010000:00010000:0.0:1784938794.705678:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f3cb62a/0xcd9d312a94a083a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->118783) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cca expref: 50 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705695:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb size from disk: 0 -> 4915 00002000:00010000:0.0:1784938794.705698:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:0.0:1784938794.705700:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:0.0:1784938794.705702:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb blocks from disk: 1 -> 19 00010000:00010000:0.0:1784938794.705710:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b182753/0xcd9d312a94a0756b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5752 expref: 49 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705748:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 0 -> 423 00002000:00010000:0.0:1784938794.705791:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:0.0:1784938794.705794:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb ctime from disk: 0 -> 1784938784 00002000:00010000:0.0:1784938794.705796:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1784938794.705807:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6937f9d/0xcd9d312a94a08015 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b6c expref: 48 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705825:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb size from disk: 0 -> 316748 00002000:00010000:0.0:1784938794.705828:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x27:0x0] updating lvb mtime from disk: 0 -> 1784938787 00010000:00010000:0.0:1784938794.705835:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a08abf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->319487) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f86 expref: 47 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705853:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb size from disk: 0 -> 1790 00002000:00010000:0.0:1784938794.705856:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:0.0:1784938794.705858:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1784938784 00002000:00010000:0.0:1784938794.705861:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1784938794.705871:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c61d0/0xcd9d312a94a07c87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a0e expref: 46 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705889:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 15476 00002000:00010000:0.0:1784938794.705892:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:0.0:1784938794.705894:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:0.0:1784938794.705896:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 35 00010000:00010000:0.0:1784938794.705903:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006946fef3/0xcd9d312a94a07262 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5633 expref: 45 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705934:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 254129 00002000:00010000:0.0:1784938794.705937:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1784938786 00002000:00010000:0.0:1784938794.705939:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1784938786 00010000:00010000:0.0:1784938794.705949:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a08731 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->258047) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e28 expref: 44 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705966:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb size from disk: 0 -> 7185 00002000:00010000:0.0:1784938794.705968:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:0.0:1784938794.705971:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:0.0:1784938794.705973:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb blocks from disk: 1 -> 19 00010000:00010000:0.0:1784938794.705980:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a07bd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59c8 expref: 43 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.705999:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 38517 00002000:00010000:0.0:1784938794.706001:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:0.0:1784938794.706004:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:0.0:1784938794.706006:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 131 00010000:00010000:0.0:1784938794.706014:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a071ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ed expref: 42 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938794.706030:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb size from disk: 0 -> 111139 00002000:00010000:0.0:1784938794.706033:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:0.0:1784938794.706035:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb ctime from disk: 0 -> 1784938784 00002000:00010000:0.0:1784938794.706037:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb blocks from disk: 1 -> 259 00010000:00010000:0.0:1784938794.706045:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab105ca9/0xcd9d312a94a07df3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a9a expref: 41 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938794.706718:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb size from disk: 0 -> 4207 00002000:00010000:2.0:1784938794.706723:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:2.0:1784938794.706725:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:2.0:1784938794.706727:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb blocks from disk: 1 -> 19 00010000:00010000:2.0:1784938794.706746:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000476a8c1d/0xcd9d312a94a073f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56bf expref: 40 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938794.706805:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb size from disk: 0 -> 1179443 00002000:00010000:2.0:1784938794.706808:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb mtime from disk: 0 -> 1784938786 00002000:00010000:2.0:1784938794.706810:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb ctime from disk: 0 -> 1784938786 00002000:00010000:2.0:1784938794.706813:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1784938794.706823:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0889d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1179647) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5eb4 expref: 39 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938794.706842:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb size from disk: 0 -> 2192 00002000:00010000:2.0:1784938794.706845:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:2.0:1784938794.706847:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:2.0:1784938794.706850:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1784938794.706868:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092c1b45d/0xcd9d312a94a07843 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d586a expref: 38 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938794.706888:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb size from disk: 0 -> 234 00002000:00010000:2.0:1784938794.706891:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:2.0:1784938794.706903:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:2.0:1784938794.706905:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1784938794.706917:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6454cd8/0xcd9d312a94a07a65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d593c expref: 37 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938794.706937:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 5634 00002000:00010000:2.0:1784938794.706940:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784938781 00002000:00010000:2.0:1784938794.706942:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784938781 00002000:00010000:2.0:1784938794.706944:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 19 00010000:00010000:2.0:1784938794.706952:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc12abee/0xcd9d312a94a07040 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5561 expref: 36 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938794.706970:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb size from disk: 0 -> 215293 00002000:00010000:2.0:1784938794.706973:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb mtime from disk: 0 -> 1784938785 00002000:00010000:2.0:1784938794.706976:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb ctime from disk: 0 -> 1784938785 00010000:00010000:2.0:1784938794.706984:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d16a20e0/0xcd9d312a94a0850f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->217087) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d56 expref: 35 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938794.707004:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb size from disk: 0 -> 2858 00002000:00010000:2.0:1784938794.707007:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:2.0:1784938794.707009:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:2.0:1784938794.707012:0:31441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1784938794.707019:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee29a2fb/0xcd9d312a94a076d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57de expref: 34 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938794.707036:0:31441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb size from disk: 0 -> 1408 00002000:00010000:2.0:1784938794.707039:0:31441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:2.0:1784938794.707047:0:31441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb ctime from disk: 0 -> 1784938784 00010000:00010000:2.0:1784938794.707056:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000144632bd/0xcd9d312a94a08181 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bf8 expref: 33 pid: 33065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.707072:0:31441:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97473b75b800, canceled 38 locks, left on hash table 0. 00010000:00010000:2.0:1784938794.707112:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938794.707114:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938794.707117:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938794.734298:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938794.734502:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326178688 00000100:00100000:3.0:1784938794.734517:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326178688 00000100:00100000:0.0:1784938794.734665:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 171 00000100:00100000:0.0:1784938794.734680:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+77:10022:x1871643326178688:12345-192.168.202.4@tcp:9:umount.0 00000020:00000080:0.0:1784938794.734737:0:33065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06e8e 00000020:00010000:0.0:1784938794.734799:0:33065:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97473b75a800: total 0 00000100:00080000:0.0:1784938794.734806:0:33065:0:(import.c:65:import_set_state_nolock()) ffff97473b758800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938794.734877:0:33065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967346 00000100:00100000:0.0:1784938794.735224:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+75:10022:x1871643326178688:12345-192.168.202.4@tcp:9:umount.0 Request processed in 546us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938794.735233:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 171 00000020:00010000:3.0:1784938794.740689:0:30619:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97473b75a800: total 0 00010000:00010000:3.0:1784938794.740808:0:30619:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97473b75a800, canceled 0 locks, left on hash table 40. 00002000:00010000:3.0:1784938794.740869:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size from disk: 0 -> 3006 00002000:00010000:3.0:1784938794.740875:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.740878:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.740880:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1784938794.740927:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005991e1c3/0xcd9d312a94a077e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5847 expref: 74 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.740961:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb size from disk: 0 -> 6548 00002000:00010000:3.0:1784938794.740963:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb mtime from disk: 0 -> 1784938785 00002000:00010000:3.0:1784938794.740965:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb ctime from disk: 0 -> 1784938785 00010000:00010000:3.0:1784938794.740971:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067e9ee13/0xcd9d312a94a08292 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c61 expref: 73 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.740987:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb size from disk: 0 -> 31711 00002000:00010000:3.0:1784938794.740988:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb mtime from disk: 0 -> 1784938785 00002000:00010000:3.0:1784938794.740990:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb ctime from disk: 0 -> 1784938785 00010000:00010000:3.0:1784938794.740994:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6729339/0xcd9d312a94a084b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d33 expref: 72 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741042:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb size from disk: 0 -> 2129 00002000:00010000:3.0:1784938794.741044:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:3.0:1784938794.741047:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb ctime from disk: 0 -> 1784938784 00002000:00010000:3.0:1784938794.741049:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1784938794.741060:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000525f600e/0xcd9d312a94a07f04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b03 expref: 71 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741078:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb size from disk: 0 -> 1754 00002000:00010000:3.0:1784938794.741081:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.741083:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.741085:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x9:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1784938794.741091:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000288e091f/0xcd9d312a94a07509 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5728 expref: 70 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741110:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb size from disk: 0 -> 1753 00002000:00010000:3.0:1784938794.741112:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:3.0:1784938794.741114:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb ctime from disk: 0 -> 1784938784 00010000:00010000:3.0:1784938794.741121:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d13bd41/0xcd9d312a94a08126 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bd5 expref: 69 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741151:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb size from disk: 0 -> 4150 00002000:00010000:3.0:1784938794.741154:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.741156:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.741158:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb blocks from disk: 1 -> 19 00010000:00010000:3.0:1784938794.741168:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003598b9f9/0xcd9d312a94a07b76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59a5 expref: 68 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741201:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 9974 00002000:00010000:3.0:1784938794.741204:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.741206:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.741208:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 35 00010000:00010000:3.0:1784938794.741219:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abdd541d/0xcd9d312a94a07151 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55ca expref: 67 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741241:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb size from disk: 0 -> 227516 00002000:00010000:3.0:1784938794.741243:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb mtime from disk: 0 -> 1784938785 00002000:00010000:3.0:1784938794.741244:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb ctime from disk: 0 -> 1784938785 00010000:00010000:3.0:1784938794.741251:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000211df11e/0xcd9d312a94a08620 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->229375) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dbf expref: 66 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741266:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x24:0x0] updating lvb size from disk: 0 -> 26716 00002000:00010000:3.0:1784938794.741268:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x24:0x0] updating lvb mtime from disk: 0 -> 1784938786 00002000:00010000:3.0:1784938794.741269:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x24:0x0] updating lvb ctime from disk: 0 -> 1784938786 00010000:00010000:3.0:1784938794.741274:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda97abe/0xcd9d312a94a08842 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e91 expref: 65 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741286:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 0 -> 1694 00002000:00010000:3.0:1784938794.741288:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:3.0:1784938794.741289:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 0 -> 1784938784 00002000:00010000:3.0:1784938794.741290:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1784938794.741294:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001760d2e/0xcd9d312a94a07ce2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a31 expref: 64 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741318:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 674 00002000:00010000:3.0:1784938794.741320:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.741321:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.741323:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1784938794.741328:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000573ac59a/0xcd9d312a94a072e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5656 expref: 63 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741341:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb size from disk: 0 -> 42517 00002000:00010000:3.0:1784938794.741343:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x23:0x0] updating lvb mtime from disk: 0 -> 1784938786 00010000:00010000:3.0:1784938794.741347:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a034279/0xcd9d312a94a0878c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e4b expref: 62 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741360:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1784938794.741361:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb mtime from disk: 0 -> 1784938787 00002000:00010000:3.0:1784938794.741362:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb ctime from disk: 0 -> 1784938787 00002000:00010000:3.0:1784938794.741363:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x29:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1784938794.741368:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001be8c486/0xcd9d312a94a08b9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fcc expref: 61 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741380:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x26:0x0] updating lvb size from disk: 0 -> 24288 00002000:00010000:3.0:1784938794.741382:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x26:0x0] updating lvb mtime from disk: 0 -> 1784938786 00002000:00010000:3.0:1784938794.741383:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x26:0x0] updating lvb ctime from disk: 0 -> 1784938786 00010000:00010000:3.0:1784938794.741388:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a089ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f1d expref: 60 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741409:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb size from disk: 0 -> 6813 00002000:00010000:3.0:1784938794.741410:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.741412:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.741413:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb blocks from disk: 1 -> 19 00010000:00010000:3.0:1784938794.741419:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf6ac6c8/0xcd9d312a94a07954 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58d3 expref: 59 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.741432:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 0 -> 143467 00002000:00010000:3.0:1784938794.741434:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 1784938785 00002000:00010000:3.0:1784938794.741435:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 1784938785 00010000:00010000:3.0:1784938794.743008:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058b81ed2/0xcd9d312a94a083fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->147455) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ced expref: 58 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.743078:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 903 00002000:00010000:3.0:1784938794.743082:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784938781 00002000:00010000:3.0:1784938794.743084:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784938781 00002000:00010000:3.0:1784938794.743086:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1784938794.743106:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000718078d0/0xcd9d312a94a06fc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5537 expref: 57 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.743128:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 0 -> 1613 00002000:00010000:3.0:1784938794.743131:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.743134:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.743136:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1784938794.744320:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3a695dc/0xcd9d312a94a075c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5775 expref: 56 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.744391:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb size from disk: 0 -> 1342 00002000:00010000:3.0:1784938794.744394:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:3.0:1784938794.744396:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb ctime from disk: 0 -> 1784938784 00010000:00010000:3.0:1784938794.744407:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cd6c8dc/0xcd9d312a94a08070 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b8f expref: 55 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.744431:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x28:0x0] updating lvb size from disk: 0 -> 4512 00002000:00010000:3.0:1784938794.744435:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x28:0x0] updating lvb mtime from disk: 0 -> 1784938787 00002000:00010000:3.0:1784938794.744437:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x28:0x0] updating lvb ctime from disk: 0 -> 1784938787 00010000:00010000:3.0:1784938794.744445:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a08b1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fa9 expref: 54 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.744465:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb size from disk: 0 -> 198050 00002000:00010000:3.0:1784938794.744468:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb mtime from disk: 0 -> 1784938785 00002000:00010000:3.0:1784938794.744470:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb ctime from disk: 0 -> 1784938785 00010000:00010000:3.0:1784938794.744491:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039cbf935/0xcd9d312a94a0856a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->200703) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d79 expref: 53 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.744514:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb size from disk: 0 -> 18269 00002000:00010000:3.0:1784938794.744516:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.744519:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.744521:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb blocks from disk: 1 -> 67 00010000:00010000:3.0:1784938794.744529:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7004140/0xcd9d312a94a07732 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->20479) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5801 expref: 52 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.744582:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb size from disk: 0 -> 855 00002000:00010000:3.0:1784938794.744585:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:3.0:1784938794.744587:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb ctime from disk: 0 -> 1784938784 00010000:00010000:3.0:1784938794.744597:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033753a40/0xcd9d312a94a081dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c1b expref: 51 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.744617:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb size from disk: 0 -> 35427 00002000:00010000:3.0:1784938794.744620:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:3.0:1784938794.744623:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb ctime from disk: 0 -> 1784938784 00002000:00010000:3.0:1784938794.744625:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb blocks from disk: 1 -> 131 00010000:00010000:3.0:1784938794.744634:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa4469e8/0xcd9d312a94a07e4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5abd expref: 50 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.744661:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb size from disk: 0 -> 28245 00002000:00010000:3.0:1784938794.744664:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.744666:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.744668:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x8:0x0] updating lvb blocks from disk: 1 -> 67 00010000:00010000:3.0:1784938794.744676:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8818ac0/0xcd9d312a94a07453 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->28671) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56e2 expref: 49 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.744696:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x25:0x0] updating lvb size from disk: 0 -> 5105 00002000:00010000:3.0:1784938794.744699:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x25:0x0] updating lvb mtime from disk: 0 -> 1784938786 00002000:00010000:3.0:1784938794.744701:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x25:0x0] updating lvb ctime from disk: 0 -> 1784938786 00010000:00010000:3.0:1784938794.744709:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdd6a7f/0xcd9d312a94a088f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ed7 expref: 48 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.744764:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 0 -> 4117 00002000:00010000:3.0:1784938794.744767:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.744770:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.744773:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 1 -> 19 00010000:00010000:3.0:1784938794.745099:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac7a04bb/0xcd9d312a94a07ac0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d595f expref: 47 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.745125:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 391200 00002000:00010000:3.0:1784938794.745128:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784938781 00002000:00010000:3.0:1784938794.745131:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1784938781 00002000:00010000:3.0:1784938794.745133:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1027 00010000:00010000:3.0:1784938794.745155:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c7a2c38/0xcd9d312a94a0709b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5584 expref: 46 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.745177:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb size from disk: 0 -> 37842 00002000:00010000:3.0:1784938794.745180:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:3.0:1784938794.745182:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 0 -> 1784938784 00002000:00010000:3.0:1784938794.745184:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb blocks from disk: 1 -> 131 00010000:00010000:3.0:1784938794.745194:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ed80bb2/0xcd9d312a94a07fba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b49 expref: 45 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.745271:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x27:0x0] updating lvb size from disk: 0 -> 1765 00002000:00010000:3.0:1784938794.745274:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x27:0x0] updating lvb mtime from disk: 0 -> 1784938787 00002000:00010000:3.0:1784938794.745277:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x27:0x0] updating lvb ctime from disk: 0 -> 1784938787 00010000:00010000:3.0:1784938794.745287:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a08a64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f63 expref: 44 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.745316:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb size from disk: 0 -> 269 00002000:00010000:3.0:1784938794.745319:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.745321:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.745324:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x10:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1784938794.745333:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9558ab1/0xcd9d312a94a07a0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5919 expref: 43 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.745351:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb size from disk: 0 -> 8441 00002000:00010000:3.0:1784938794.745354:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.745356:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.745359:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb blocks from disk: 1 -> 35 00010000:00010000:3.0:1784938794.745366:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf55230d/0xcd9d312a94a07c2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59eb expref: 42 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.745385:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 39343 00002000:00010000:3.0:1784938794.745388:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.745389:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.745391:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 131 00010000:00010000:3.0:1784938794.745398:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a07207 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5610 expref: 41 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.745414:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 88087 00002000:00010000:3.0:1784938794.745417:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1784938786 00002000:00010000:3.0:1784938794.745419:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1784938786 00010000:00010000:3.0:1784938794.745425:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb09303f/0xcd9d312a94a086d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e05 expref: 40 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.745454:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb size from disk: 0 -> 838 00002000:00010000:3.0:1784938794.745457:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.745459:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.745461:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xb:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1784938794.745470:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcc05294/0xcd9d312a94a0767c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57bb expref: 39 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.745489:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size from disk: 0 -> 938 00002000:00010000:3.0:1784938794.745492:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb mtime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.745495:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb ctime from disk: 0 -> 1784938783 00002000:00010000:3.0:1784938794.745497:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1784938794.745505:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055f6d12b/0xcd9d312a94a0789e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d588d expref: 38 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.745523:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb size from disk: 0 -> 6821 00002000:00010000:3.0:1784938794.745525:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb mtime from disk: 0 -> 1784938785 00002000:00010000:3.0:1784938794.745527:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb ctime from disk: 0 -> 1784938785 00010000:00010000:3.0:1784938794.745536:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075805b86/0xcd9d312a94a08348 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ca7 expref: 37 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.745554:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb size from disk: 0 -> 6234 00002000:00010000:3.0:1784938794.745557:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb mtime from disk: 0 -> 1784938784 00002000:00010000:3.0:1784938794.745559:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb ctime from disk: 0 -> 1784938784 00002000:00010000:3.0:1784938794.745561:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb blocks from disk: 1 -> 19 00010000:00010000:3.0:1784938794.745568:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9471409/0xcd9d312a94a07d98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a77 expref: 36 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938794.745599:0:30619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb size from disk: 0 -> 2659 00002000:00010000:3.0:1784938794.745602:0:30619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.745603:0:30619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1784938782 00002000:00010000:3.0:1784938794.745605:0:30619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x7:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1784938794.745615:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000446f1ddd/0xcd9d312a94a0739d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d569c expref: 35 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938794.745634:0:30619:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97473b75a800, canceled 40 locks, left on hash table 0. 00010000:00010000:3.0:1784938794.745684:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938794.745687:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938794.745690:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938794.763794:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938794.764023:0:33061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326189696 00000100:00100000:3.0:1784938794.764038:0:33061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326189696 00000100:00080000:0.0:1784938794.764194:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938794.764344:0:33061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 361 00000100:00100000:3.0:1784938794.764359:0:33061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+90:10022:x1871643326189696:12345-192.168.202.4@tcp:39:umount.0 00000020:00000080:3.0:1784938794.764424:0:33061:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06e87 00000020:00010000:3.0:1784938794.764437:0:33061:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97473b75d800: total 0 00000100:00080000:3.0:1784938794.764443:0:33061:0:(import.c:65:import_set_state_nolock()) ffff97473b75e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784938794.764483:0:33061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967564 00000100:00100000:3.0:1784938794.765356:0:33061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ec7c535-1b11-4e0e-8d43-d37b8591d8b1+89:10022:x1871643326189696:12345-192.168.202.4@tcp:39:umount.0 Request processed in 994us (1612us total) trans 4294967565 rc 0/0 00000100:00100000:3.0:1784938794.765368:0:33061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 361 00000020:00010000:0.0:1784938794.765454:0:30618:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97473b75d800: total 0 00010000:00010000:0.0:1784938794.765523:0:30618:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97473b75d800, canceled 0 locks, left on hash table 85. 00010000:00010000:0.0:1784938794.765567:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff97473a027300) 00010000:00010000:0.0:1784938794.765571:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938794.765582:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568600/0xcd9d312a94a07eef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5af5 expref: 88 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938794.765619:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff974705272100) 00010000:00010000:0.0:1784938794.765622:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938794.765626:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29c00/0xcd9d312a94a074f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d571a expref: 87 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938794.765648:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff97460907c800) 00010000:00010000:0.0:1784938794.765651:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938794.765654:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0e00/0xcd9d312a94a08999 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f0f expref: 86 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.765740:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff97473a027a00) 00010000:00010000:2.0:1784938794.765744:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.765774:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569e00/0xcd9d312a94a07d28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a46 expref: 85 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.765797:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff97470909ed00) 00010000:00010000:2.0:1784938794.765801:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.765807:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742173e00/0xcd9d312a94a0732d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d566b expref: 84 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.765827:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9747214caf00) 00010000:00010000:2.0:1784938794.765829:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.765834:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742044a00/0xcd9d312a94a087d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e60 expref: 83 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.765853:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x18:0x0].0x0 (ffff974703b59d00) 00010000:00010000:2.0:1784938794.765855:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.765870:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b000/0xcd9d312a94a07778 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5816 expref: 82 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.765891:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff97473e984800) 00010000:00010000:2.0:1784938794.765900:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.765906:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05a00/0xcd9d312a94a07b61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5997 expref: 81 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.765926:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97470909e800) 00010000:00010000:2.0:1784938794.765928:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.765932:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00000/0xcd9d312a94a0713c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55bc expref: 80 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.765947:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff974702d24900) 00010000:00010000:2.0:1784938794.765949:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.765954:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b400/0xcd9d312a94a0860b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5db1 expref: 79 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.765972:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff974703b59700) 00010000:00010000:2.0:1784938794.765974:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.765979:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172e00/0xcd9d312a94a075b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5767 expref: 78 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.765996:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff974710f9bc00) 00010000:00010000:2.0:1784938794.765998:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766002:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04000/0xcd9d312a94a0799a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58e8 expref: 77 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766019:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff97473e984e00) 00010000:00010000:2.0:1784938794.766022:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766026:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a08444 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d02 expref: 76 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766060:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff97460a2ef100) 00010000:00010000:2.0:1784938794.766062:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938794.766067:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1a00/0xcd9d312a94a08b44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fb0 expref: 75 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766083:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff974707d24600) 00010000:00010000:2.0:1784938794.766086:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766089:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569a00/0xcd9d312a94a077d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5839 expref: 74 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766104:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff97471360e700) 00010000:00010000:2.0:1784938794.766106:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766109:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209b600/0xcd9d312a94a0827d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c53 expref: 73 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766123:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x14:0x0].0x0 (ffff974707d24800) 00010000:00010000:2.0:1784938794.766126:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766129:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569200/0xcd9d312a94a0760c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d578a expref: 72 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766154:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff97473a027f00) 00010000:00010000:2.0:1784938794.766157:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766161:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569c00/0xcd9d312a94a080b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ba4 expref: 71 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766178:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff97460a2ef400) 00010000:00010000:2.0:1784938794.766187:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938794.766192:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1200/0xcd9d312a94a08b75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fbe expref: 70 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766209:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97470909e000) 00010000:00010000:2.0:1784938794.766212:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766215:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00200/0xcd9d312a94a070e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5599 expref: 69 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766231:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff97471a350900) 00010000:00010000:2.0:1784938794.766234:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766237:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045600/0xcd9d312a94a085b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d8e expref: 68 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766250:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff974703b59000) 00010000:00010000:2.0:1784938794.766252:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766255:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742173c00/0xcd9d312a94a07556 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5744 expref: 67 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766272:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff974705478100) 00010000:00010000:2.0:1784938794.766275:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766279:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251200/0xcd9d312a94a08000 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b5e expref: 66 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766295:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff97473635e000) 00010000:00010000:2.0:1784938794.766298:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766302:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b200/0xcd9d312a94a0793f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58c5 expref: 65 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766336:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff97471a350a00) 00010000:00010000:2.0:1784938794.766339:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766343:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ae00/0xcd9d312a94a083e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cdf expref: 64 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766357:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff974705272700) 00010000:00010000:2.0:1784938794.766360:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766363:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b800/0xcd9d312a94a06fb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5529 expref: 63 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766378:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff97473e984a00) 00010000:00010000:2.0:1784938794.766380:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766383:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04400/0xcd9d312a94a07e39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5aaf expref: 62 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766399:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff97473635e300) 00010000:00010000:2.0:1784938794.766402:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766405:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f28a00/0xcd9d312a94a0743e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56d4 expref: 61 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766419:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff97460907c000) 00010000:00010000:2.0:1784938794.766422:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766426:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb400/0xcd9d312a94a08222 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c30 expref: 60 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766443:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9747052c8200) 00010000:00010000:2.0:1784938794.766452:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766457:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209bc00/0xcd9d312a94a07c72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a00 expref: 59 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766476:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff974705272a00) 00010000:00010000:2.0:1784938794.766479:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766483:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b400/0xcd9d312a94a0724d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5625 expref: 58 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766501:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974705272d00) 00010000:00010000:2.0:1784938794.766503:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938794.766507:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924f800/0xcd9d312a94a06ef0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54f8 expref: 57 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766523:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff97460907cf00) 00010000:00010000:2.0:1784938794.766526:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766530:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251600/0xcd9d312a94a0805b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b81 expref: 56 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766544:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff974702d24f00) 00010000:00010000:2.0:1784938794.766546:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766550:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a08b05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f9b expref: 55 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766566:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff97473e984900) 00010000:00010000:2.0:1784938794.766568:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766572:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05600/0xcd9d312a94a07aab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5951 expref: 54 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766598:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff974607c00600) 00010000:00010000:2.0:1784938794.766600:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766605:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609397200/0xcd9d312a94a07086 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5576 expref: 53 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766621:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff97460a2efc00) 00010000:00010000:2.0:1784938794.766623:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938794.766627:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1400/0xcd9d312a94a09133 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fda expref: 52 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766642:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff97473e984100) 00010000:00010000:2.0:1784938794.766645:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766649:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05200/0xcd9d312a94a07e94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ad2 expref: 51 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766662:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff974710f9be00) 00010000:00010000:2.0:1784938794.766665:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766668:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fa00/0xcd9d312a94a07499 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56f7 expref: 50 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766681:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9747214cac00) 00010000:00010000:2.0:1784938794.766683:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766687:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045e00/0xcd9d312a94a0893e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5eec expref: 49 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766700:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1c:0x0].0x0 (ffff974710f9b100) 00010000:00010000:2.0:1784938794.766707:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766713:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148ba00/0xcd9d312a94a078e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d58a2 expref: 48 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766729:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff97473e984700) 00010000:00010000:2.0:1784938794.766732:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766736:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05800/0xcd9d312a94a07ccd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a23 expref: 47 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766797:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97470909e500) 00010000:00010000:2.0:1784938794.766800:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766804:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742173000/0xcd9d312a94a072d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5648 expref: 46 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766820:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff97470909e700) 00010000:00010000:2.0:1784938794.766823:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938794.766826:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e00a00/0xcd9d312a94a06f28 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5506 expref: 45 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766840:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff974703b59200) 00010000:00010000:2.0:1784938794.766842:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766846:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a200/0xcd9d312a94a0771d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57f3 expref: 44 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766860:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff974707d24000) 00010000:00010000:2.0:1784938794.766863:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766867:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ba00/0xcd9d312a94a081c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c0d expref: 43 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766893:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9747052c8a00) 00010000:00010000:2.0:1784938794.766895:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766900:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209ac00/0xcd9d312a94a07b06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5974 expref: 42 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766915:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff97473e984c00) 00010000:00010000:2.0:1784938794.766918:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766922:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea05e00/0xcd9d312a94a07c17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59dd expref: 41 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766938:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97473635ea00) 00010000:00010000:2.0:1784938794.766940:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766944:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29600/0xcd9d312a94a071f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5602 expref: 40 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766959:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff97472ff12200) 00010000:00010000:2.0:1784938794.766961:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.766965:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893e00/0xcd9d312a94a086c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5df7 expref: 39 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766979:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974705272900) 00010000:00010000:2.0:1784938794.766981:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938794.766984:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924ea00/0xcd9d312a94a06f59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5514 expref: 38 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.766999:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff97473a027600) 00010000:00010000:2.0:1784938794.767006:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767011:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735568c00/0xcd9d312a94a07a50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d592e expref: 37 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767041:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97470909e200) 00010000:00010000:2.0:1784938794.767044:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767048:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01200/0xcd9d312a94a0702b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5553 expref: 36 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767064:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff974702d24500) 00010000:00010000:2.0:1784938794.767066:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767070:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a084fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d48 expref: 35 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767084:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff97471a2bc800) 00010000:00010000:2.0:1784938794.767086:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767089:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741250600/0xcd9d312a94a088e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ec9 expref: 34 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767103:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff974705478300) 00010000:00010000:2.0:1784938794.767106:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767110:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251800/0xcd9d312a94a07889 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d587f expref: 33 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767125:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff97460907c400) 00010000:00010000:2.0:1784938794.767127:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767131:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddba00/0xcd9d312a94a08333 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c99 expref: 32 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767173:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff974702d24400) 00010000:00010000:2.0:1784938794.767176:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767180:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b200/0xcd9d312a94a0871c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e1a expref: 31 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767195:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x16:0x0].0x0 (ffff974710f9b500) 00010000:00010000:2.0:1784938794.767198:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767202:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924fc00/0xcd9d312a94a076c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57d0 expref: 30 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767216:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff97472ff12800) 00010000:00010000:2.0:1784938794.767219:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767223:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04600/0xcd9d312a94a08b91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fc5 expref: 29 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767237:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff97460907c300) 00010000:00010000:2.0:1784938794.767240:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767243:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddae00/0xcd9d312a94a0816c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bea expref: 28 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767260:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff97471a350e00) 00010000:00010000:2.0:1784938794.767262:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767266:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a08555 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d6b expref: 27 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767282:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff97473e984b00) 00010000:00010000:2.0:1784938794.767290:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767295:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04e00/0xcd9d312a94a07fa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b3b expref: 26 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767314:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff97460a2efa00) 00010000:00010000:2.0:1784938794.767317:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767321:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c0200/0xcd9d312a94a08a4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f55 expref: 25 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767338:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff974609f5de00) 00010000:00010000:2.0:1784938794.767341:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767345:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddac00/0xcd9d312a94a0838e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5cbc expref: 24 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767360:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff974705478200) 00010000:00010000:2.0:1784938794.767363:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767366:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741251400/0xcd9d312a94a07dde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a8c expref: 23 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767382:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff974607c00200) 00010000:00010000:2.0:1784938794.767384:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767388:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031c00/0xcd9d312a94a073e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d56b1 expref: 22 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767404:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff974609f5d100) 00010000:00010000:2.0:1784938794.767407:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767411:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974602ddb800/0xcd9d312a94a08888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ea6 expref: 21 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767441:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff97473a027c00) 00010000:00010000:2.0:1784938794.767443:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767448:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735569000/0xcd9d312a94a0782e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d585c expref: 20 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767462:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff974705478500) 00010000:00010000:2.0:1784938794.767464:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767468:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892a00/0xcd9d312a94a082d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5c76 expref: 19 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767483:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97470909e100) 00010000:00010000:2.0:1784938794.767486:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938794.767489:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974741e01800/0xcd9d312a94a06f0c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d54ff expref: 18 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767502:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x15:0x0].0x0 (ffff974711893e00) 00010000:00010000:2.0:1784938794.767505:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767509:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974700031e00/0xcd9d312a94a07667 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d57ad expref: 17 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767523:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974705272600) 00010000:00010000:2.0:1784938794.767526:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938794.767530:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97470148b600/0xcd9d312a94a06fe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d553e expref: 16 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767544:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff97473e984200) 00010000:00010000:2.0:1784938794.767551:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767556:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460924e000/0xcd9d312a94a08111 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5bc7 expref: 15 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767572:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff97473e984300) 00010000:00010000:2.0:1784938794.767575:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767579:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04800/0xcd9d312a94a07f4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5b18 expref: 14 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767595:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9747214ca000) 00010000:00010000:2.0:1784938794.767597:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767601:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742045800/0xcd9d312a94a089f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5f32 expref: 13 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767615:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff97471360e300) 00010000:00010000:2.0:1784938794.767618:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767621:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a07d83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5a69 expref: 12 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767635:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97473635e400) 00010000:00010000:2.0:1784938794.767637:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767641:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974735f29400/0xcd9d312a94a07388 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d568e expref: 11 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767654:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff974702d24000) 00010000:00010000:2.0:1784938794.767656:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767660:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290b000/0xcd9d312a94a0882d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5e83 expref: 10 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767687:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9747052c8500) 00010000:00010000:2.0:1784938794.767689:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767694:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a07bbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d59ba expref: 9 pid: 33061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767723:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff974607c00700) 00010000:00010000:2.0:1784938794.767726:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767730:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974609396400/0xcd9d312a94a07197 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d55df expref: 8 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767746:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9747029bbd00) 00010000:00010000:2.0:1784938794.767781:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767786:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892400/0xcd9d312a94a08666 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5dd4 expref: 7 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767803:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff97473e984400) 00010000:00010000:2.0:1784938794.767805:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767809:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97473ea04a00/0xcd9d312a94a079f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d590b expref: 6 pid: 30630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767823:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff97471a350c00) 00010000:00010000:2.0:1784938794.767825:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938794.767828:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974742172600/0xcd9d312a94a0849f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5d25 expref: 5 pid: 30632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767844:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff97472ff12f00) 00010000:00010000:2.0:1784938794.767851:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938794.767857:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460b0c1c00/0xcd9d312a94a09125 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fd3 expref: 4 pid: 30631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.767873:0:30618:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97473b75d800, canceled 85 locks, left on hash table 0. 00010000:00010000:2.0:1784938794.767917:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938794.767920:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938794.767923:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938794.797930:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938794.798223:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326189952 00000100:00100000:3.0:1784938794.798238:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326189952 00000100:00100000:3.0:1784938794.798323:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 157 00000100:00100000:3.0:1784938794.798335:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+7:10022:x1871643326189952:12345-192.168.202.4@tcp:251:umount.0 00000020:00000080:3.0:1784938794.798427:0:30625:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06e64 00000020:00010000:3.0:1784938794.798439:0:30625:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97473c930000: total 0 00000100:00080000:3.0:1784938794.798445:0:30625:0:(import.c:65:import_set_state_nolock()) ffff97473c932800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1784938794.798513:0:31441:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97473c930000: total 0 00010000:00010000:2.0:1784938794.798518:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938794.798546:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003631c3-aab2-48e6-bdb2-de6019261408+3:10022:x1871643326189952:12345-192.168.202.4@tcp:251:umount.0 Request processed in 213us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938794.798555:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 157 00010000:00010000:2.0:1784938794.798585:0:31441:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97473c930000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784938794.798640:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974735f28200/0xcd9d312a94a06e6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5481 expref: 2 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938794.798657:0:31441:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97473c930000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1784938794.798668:0:31441:0:(genops.c:906:class_export_put()) final put ffff97473c930000/003631c3-aab2-48e6-bdb2-de6019261408 00010000:00010000:2.0:1784938794.798684:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938794.798687:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938794.798688:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784938794.799169:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97473c930000/003631c3-aab2-48e6-bdb2-de6019261408 for MGS 00000020:00000080:3.0:1784938794.799270:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97473c932800 for MGS 00010000:00010000:3.0:1784938795.316330:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938795.379929:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938795.379955:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342563584:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938795.380252:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342564096:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938795.380325:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342563712:0@lo:400:kworker.0 00000100:00100000:2.0:1784938795.380373:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938795.380405:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342564224:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938795.380604:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938795.380662:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938795.380686:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938795.380730:0:30623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342563712 00000100:00100000:2.0:1784938795.380738:0:30623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342563712 00000100:00100000:2.0:1784938795.380804:0:30623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784938795.380814:0:30623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342563712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938795.380866:0:30623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342563712:12345-0@lo:400:kworker.0 Request processed in 53us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938795.380874:0:30623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784938795.380917:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342564096 00000100:00100000:2.0:1784938795.380921:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342564096 00000100:00100000:2.0:1784938795.380962:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 18 00000100:00100000:2.0:1784938795.380968:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472a667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342564096:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938795.381005:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472a667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342564096:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 37us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938795.381012:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 18 00000100:00100000:2.0:1784938795.382104:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342564224 00000100:00100000:2.0:1784938795.382112:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342564224 00000100:00100000:2.0:1784938795.382170:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 34 00000100:00100000:2.0:1784938795.382180:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342564224:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938795.382227:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342564224:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 50us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938795.382234:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 34 00000100:00080000:2.0:1784938795.382260:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938795.382264:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938795.382442:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342563712:0@lo:400:kworker.0 00000100:00100000:2.0:1784938795.382459:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342564224:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938795.383104:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342563840:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938795.383173:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342564352:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938795.383204:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938795.383212:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342563968:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938795.383250:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342563584 00000100:00100000:0.0:1784938795.383255:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342563584 00000100:00100000:0.0:1784938795.383295:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 20 00000100:00100000:0.0:1784938795.383304:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342563584:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938795.383322:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 66256896 pending 25559040 free 387973120 avail 385875968 00000100:00100000:0.0:1784938795.383351:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342563584:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 49us (2689us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938795.383358:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 20 00000100:00100000:2.0:1784938795.383570:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938795.383609:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938795.383637:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938795.383674:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342563840 00000100:00100000:2.0:1784938795.383678:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342563840 00000100:00100000:2.0:1784938795.383701:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342563968 00000100:00100000:2.0:1784938795.383704:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342563968 00000100:00100000:2.0:1784938795.383723:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 35 00000100:00100000:2.0:1784938795.383728:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342563840:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938795.383769:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342563840:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 41us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938795.383774:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 35 00000100:00100000:2.0:1784938795.383783:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 36 00000100:00100000:2.0:1784938795.383787:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342563968:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938795.383800:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342563968:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 14us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938795.383804:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 36 00000100:00080000:2.0:1784938795.383868:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938795.383871:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938795.383899:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342563584:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938795.383974:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342563968:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938795.384060:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342563840:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938795.386661:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342564352 00000100:00100000:3.0:1784938795.386679:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342564352 00000100:00100000:3.0:1784938795.386782:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 19 00000100:00100000:3.0:1784938795.386792:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342564352:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938795.386867:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342564352:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 76us (3257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938795.386875:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 19 00000100:00100000:2.0:1784938795.389826:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342564352:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938795.393571:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342564096:192.168.202.104@tcp:400:kworker.0 00000001:00080000:0.0:1784938795.471269:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967342 is committed 00000001:00080000:0.0:1784938795.471311:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967344 is committed 00000001:00080000:0.0:1784938795.471331:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967346 is committed 00000001:00100000:0.0:1784938795.471348:0:32270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1 00000020:00000080:0.0:1784938795.471365:0:32270:0:(genops.c:906:class_export_put()) final put ffff97473b75b800/5ec7c535-1b11-4e0e-8d43-d37b8591d8b1 00000020:00000080:3.0:1784938795.471630:0:12700:0:(genops.c:865:class_export_destroy()) destroying export ffff97473b75b800/5ec7c535-1b11-4e0e-8d43-d37b8591d8b1 for lustre-OST0001 00000020:00000080:3.0:1784938795.471686:0:12700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97473b75e000 for lustre-OST0001 00000001:00100000:1.0:1784938795.750562:0:30612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1 00000001:00080000:1.0:1784938795.750581:0:30612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967565 is committed 00000020:00000080:1.0:1784938795.750587:0:30612:0:(genops.c:906:class_export_put()) final put ffff97473b75d800/5ec7c535-1b11-4e0e-8d43-d37b8591d8b1 00000020:00000080:2.0:1784938795.750956:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97473b75d800/5ec7c535-1b11-4e0e-8d43-d37b8591d8b1 for lustre-MDT0000 00000020:00000080:2.0:1784938795.751023:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97473b75e800 for lustre-MDT0000 00010000:00010000:2.0:1784938796.339014:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938797.366420:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938798.387505:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938798.451864:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342564480:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938798.455264:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938798.460745:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342564480 00000100:00100000:0.0:1784938798.460779:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342564480 00000100:00100000:0.0:1784938798.460886:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 21 00000100:00100000:0.0:1784938798.460907:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342564480:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938798.460956:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67960832 pending 27262976 free 387973120 avail 385875968 00000100:00100000:0.0:1784938798.461029:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342564480:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 124us (5778us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938798.461037:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 21 00000100:00080000:0.0:1784938798.461069:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938798.475375:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342564480:192.168.202.104@tcp:13:osp-pre-0-0.0 00000001:00100000:0.0:1784938798.535707:0:31424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5ec7c535-1b11-4e0e-8d43-d37b8591d8b1 00000001:00080000:0.0:1784938798.535731:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967343 is committed 00000001:00080000:0.0:1784938798.536040:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967344 is committed 00000001:00080000:0.0:1784938798.536302:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00000020:00000080:0.0:1784938798.536417:0:31424:0:(genops.c:906:class_export_put()) final put ffff97473b75a800/5ec7c535-1b11-4e0e-8d43-d37b8591d8b1 00000020:00000080:1.0:1784938798.536515:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97473b75a800/5ec7c535-1b11-4e0e-8d43-d37b8591d8b1 for lustre-OST0000 00000020:00000080:1.0:1784938798.536645:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97473b758800 for lustre-OST0000 00010000:00010000:1.0:1784938799.411776:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938800.434968:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938800.500658:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342564608:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938800.501369:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938800.501451:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342564608 00000100:00100000:0.0:1784938800.501463:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342564608 00000100:00100000:0.0:1784938800.501521:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 22 00000100:00100000:0.0:1784938800.501530:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342564608:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938800.501565:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 384827392 avail 382730240 00000100:00100000:0.0:1784938800.501621:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342564608:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 91us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938800.501628:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 22 00000100:00080000:0.0:1784938800.501647:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938800.501798:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342564608:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938800.502265:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342564864:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938800.502335:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938800.502342:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342564992:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938800.502470:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938800.502540:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938800.502562:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342564864 00000100:00100000:1.0:1784938800.502567:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342564864 00000100:00100000:1.0:1784938800.502604:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342564992 00000100:00100000:1.0:1784938800.502607:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342564992 00000100:00100000:1.0:1784938800.502633:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 37 00000100:00100000:1.0:1784938800.502641:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342564864:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938800.502910:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342564864:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 268us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938800.502924:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 37 00000100:00100000:1.0:1784938800.502942:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 38 00000100:00100000:1.0:1784938800.502949:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342564992:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938800.502975:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342564992:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938800.502981:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 38 00000100:00080000:1.0:1784938800.503008:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938800.503035:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342564736:0@lo:400:kworker.0 00000100:00100000:0.0:1784938800.504695:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342565120:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938800.505792:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342564992:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938800.505817:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342564864:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938800.507729:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938800.507836:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342565248:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938800.507914:0:30625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342564736 00000100:00100000:3.0:1784938800.508056:0:30625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342564736 00000100:00100000:3.0:1784938800.508132:0:30625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784938800.508142:0:30625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974738762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342564736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938800.508198:0:30625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974738762450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342564736:12345-0@lo:400:kworker.0 Request processed in 58us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938800.508205:0:30625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784938800.508262:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342564736:0@lo:400:kworker.0 00000100:00100000:1.0:1784938800.511561:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938800.511606:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938800.511634:0:30630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342565248 00000100:00100000:1.0:1784938800.511642:0:30630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342565248 00000100:00100000:1.0:1784938800.511701:0:30630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 39 00000100:00100000:1.0:1784938800.511711:0:30630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342565248:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938800.511811:0:30630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342565248:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 101us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938800.511819:0:30630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 39 00000100:00080000:1.0:1784938800.511845:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938800.512085:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342565248:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938800.512325:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342565120 00000100:00100000:0.0:1784938800.512345:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342565120 00000100:00100000:0.0:1784938800.512418:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 20 00000100:00080000:1.0:1784938800.512424:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938800.512426:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342565120:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938800.512472:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342565120:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 46us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938800.512479:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 20 00000100:00100000:0.0:1784938800.512770:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342565120:192.168.202.104@tcp:400:kworker.0 00010000:00010000:3.0:1784938801.460369:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784938802.270192:0:33359:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1784938802.270408:0:33359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.270425:0:33359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.270432:0:33359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.270440:0:33359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.270465:0:33359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784938802.270471:0:33359:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784938802.270500:0:33359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784938802.270504:0:33359:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784938802.270509:0:33359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784938802.270534:0:33359:0:(import.c:65:import_set_state_nolock()) ffff974601dd3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784938802.270673:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342565376:192.168.202.104@tcp:39:umount.0 00000100:00100000:1.0:1784938802.271126:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00010000:00010000:2.0:1784938802.271389:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938802.271397:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938802.271406:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974735f28800 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:2.0:1784938802.271410:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938802.271419:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938802.271427:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938802.271434:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938802.271436:0:30618:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784938802.271439:0:30618:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784938802.271466:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938802.271474:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938802.271505:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938802.271513:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974735f28800/0xcd9d312a94a06e10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a06e17 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938802.271544:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938802.271546:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938802.271548:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938802.271584:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938802.271596:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342565504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938802.271639:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938802.271719:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342565504 00000100:00100000:2.0:1784938802.271726:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342565504 00000100:00100000:2.0:1784938802.271807:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784938802.271817:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12805:x1871643342565504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938802.271830:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938802.271845:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924ee00/0xcd9d312a94a06e17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a06e10 expref: 19 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938802.271858:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938802.271896:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:12805:x1871643342565504:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938802.271903:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784938802.271937:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342565504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938802.272238:0:30631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342565376 00000100:00100000:0.0:1784938802.272304:0:30631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342565376 00000100:00100000:0.0:1784938802.272344:0:30631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 362 00000100:00100000:0.0:1784938802.272351:0:30631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12801:x1871643342565376:12345-192.168.202.104@tcp:39:umount.0 00000020:00000080:0.0:1784938802.272372:0:30631:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06c81 00000100:00080000:0.0:1784938802.272380:0:30631:0:(import.c:65:import_set_state_nolock()) ffff974609e42000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784938802.272431:0:30631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:12801:x1871643342565376:12345-192.168.202.104@tcp:39:umount.0 Request processed in 80us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938802.272438:0:30631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 362 00000020:00000080:0.0:1784938802.272444:0:30631:0:(genops.c:906:class_export_put()) final put ffff974609e45800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1784938802.272463:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784938802.272589:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974609e45800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784938802.272641:0:24411:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974609e42000 for lustre-MDT0000 00000100:00080000:0.0:1784938802.272675:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974601dd3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784938802.272684:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342565376:192.168.202.104@tcp:39:umount.0 00000100:00080000:3.0:1784938802.272741:0:33359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784938802.272747:0:33359:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784938802.272774:0:33359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784938802.274691:0:33359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.274957:0:33359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.274964:0:33359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.274972:0:33359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.275099:0:33359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938802.275114:0:33359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.275122:0:33359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.275128:0:33359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.275135:0:33359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.275225:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938802.275232:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.275310:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924e200 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:0.0:1784938802.275314:0:30619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.275323:0:30619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938802.275331:0:30619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938802.275337:0:30619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784938802.275339:0:30619:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1784938802.275372:0:30619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.275379:0:30619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938802.275409:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.275415:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460924e200/0xcd9d312a94a06e2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a06e33 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.275428:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938802.275431:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.275437:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460924e600 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:0.0:1784938802.275440:0:30619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.275458:0:30619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938802.275464:0:30619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938802.275469:0:30619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1784938802.275471:0:30619:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1784938802.275482:0:30619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.275488:0:30619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938802.275506:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.275514:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938802.275515:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938802.275518:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938802.275533:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342565760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938802.275593:0:12802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938802.275654:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342565760 00000100:00100000:0.0:1784938802.275660:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342565760 00000100:00100000:0.0:1784938802.275713:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784938802.275722:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:12802:x1871643342565760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938802.275733:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938802.275746:0:30615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924e800/0xcd9d312a94a06e25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a06e1e expref: 18 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.275787:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938802.275827:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:12802:x1871643342565760:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938802.275835:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784938802.275872:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342565760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938802.275933:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938802.275943:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342565632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938802.275969:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938802.276324:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342565632 00000100:00100000:0.0:1784938802.276329:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342565632 00000100:00100000:0.0:1784938802.276363:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784938802.276370:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:12804:x1871643342565632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938802.276379:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938802.276390:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924f200/0xcd9d312a94a06e33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a06e2c expref: 17 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.276401:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938802.276435:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:12804:x1871643342565632:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938802.276441:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784938802.276501:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342565632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938802.276615:0:33359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784938802.276627:0:33359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460924e600/0xcd9d312a94a06e1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a06e25 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938802.276641:0:33359:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784938802.276650:0:33359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.276658:0:33359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.276665:0:33359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.276671:0:33359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938802.276705:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938802.276711:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938802.276718:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97470148aa00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:2.0:1784938802.276720:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938802.276728:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938802.276741:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938802.276747:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784938802.276773:0:30618:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1784938802.276791:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938802.276797:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938802.276819:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938802.276828:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938802.276829:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938802.276831:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938802.276867:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938802.276876:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342565888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938802.276904:0:12802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938802.277176:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342565888 00000100:00100000:2.0:1784938802.277181:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342565888 00000100:00100000:2.0:1784938802.277216:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784938802.277223:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:12802:x1871643342565888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938802.277231:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938802.277332:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974735f28e00/0xcd9d312a94a072b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a072af expref: 16 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938802.277346:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938802.277383:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:12802:x1871643342565888:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938802.277389:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784938802.277447:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342565888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938802.277531:0:33359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784938802.277537:0:33359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97470148aa00/0xcd9d312a94a072af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a072b6 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938802.277547:0:33359:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784938802.277555:0:33359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.277563:0:33359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.277570:0:33359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938802.277577:0:33359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.277611:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938802.277617:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.277623:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397e00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:0.0:1784938802.277626:0:31441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.277633:0:31441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938802.277640:0:31441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938802.277656:0:31441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1784938802.277659:0:31441:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1784938802.277675:0:31441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.277680:0:31441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938802.277713:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.277722:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938802.277723:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938802.277725:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938802.277771:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938802.277780:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342566016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938802.277806:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938802.277935:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342566016 00000100:00100000:0.0:1784938802.277939:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342566016 00000100:00100000:0.0:1784938802.277964:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784938802.277971:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:12805:x1871643342566016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938802.277979:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938802.277985:0:30615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924ec00/0xcd9d312a94a06bd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a06bd2 expref: 15 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938802.278088:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938802.278223:0:33359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784938802.278228:0:33359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609397e00/0xcd9d312a94a06bd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a06bd9 expref: -99 pid: 30610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938802.278241:0:33359:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1784938802.278244:0:33359:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1784938802.278247:0:33359:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1784938802.278280:0:33359:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1784938802.278285:0:33359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1784938802.278289:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1784938802.278294:0:33359:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000004:00000080:3.0:1784938802.281318:0:33359:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:2.0:1784938802.281437:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938802.282438:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:12805:x1871643342566016:12345-0@lo:103:ldlm_bl.0 Request processed in 4462us (4625us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938802.282452:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:00000080:2.0:1784938802.287041:0:33359:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1784938802.287069:0:33359:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97471d976000 lustre-MDT0000-lwp-OST0001_UUID 192.168.202.104@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784938802.287076:0:33359:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97471d965800 lustre-MDT0000-lwp-OST0000_UUID 192.168.202.104@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784938802.287093:0:33359:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff974609e88000) has exports, disconnecting them 00000020:00080000:2.0:1784938802.287098:0:33359:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.104@tcp (ffff97471d976000), last request at 1784938800 00000020:00000080:2.0:1784938802.287106:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06de6 00000100:00080000:2.0:1784938802.287115:0:33359:0:(import.c:65:import_set_state_nolock()) ffff97471d974000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784938802.287143:0:33359:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.104@tcp (ffff97471d976000): rc 0 00000020:00000080:2.0:1784938802.287146:0:33359:0:(genops.c:906:class_export_put()) final put ffff97471d976000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1784938802.287162:0:33359:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.104@tcp (ffff97471d965800), last request at 1784938800 00000020:00000080:2.0:1784938802.287165:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06d1b 00000100:00080000:2.0:1784938802.287171:0:33359:0:(import.c:65:import_set_state_nolock()) ffff974703e4f000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784938802.287181:0:33359:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.104@tcp (ffff97471d965800): rc 0 00000020:00000080:2.0:1784938802.287183:0:33359:0:(genops.c:906:class_export_put()) final put ffff97471d965800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1784938802.287190:0:33359:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa2eec53f3ae0 00000020:00000080:0.0:1784938802.287206:0:12700:0:(genops.c:865:class_export_destroy()) destroying export ffff97471d976000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:2.0:1784938802.287209:0:33359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784938802.287212:0:33359:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967319 gen 3 00000004:00080000:2.0:1784938802.287222:0:33359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:0.0:1784938802.287255:0:12700:0:(genops.c:865:class_export_destroy()) destroying export ffff97471d965800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784938802.287278:0:12700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97471d974000 for lustre-MDT0000 00000020:00000080:0.0:1784938802.287282:0:12700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974703e4f000 for lustre-MDT0000 00000100:00080000:2.0:1784938802.287283:0:33359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784938802.287305:0:33359:0:(import.c:65:import_set_state_nolock()) ffff974607a56800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1784938802.287306:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784938802.287322:0:33359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784938802.287324:0:33359:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967319 gen 3 00000004:00080000:2.0:1784938802.287333:0:33359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938802.287335:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342566144:192.168.202.104@tcp:9:umount.0 00000100:00080000:2.0:1784938802.287395:0:33359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784938802.287403:0:33359:0:(import.c:65:import_set_state_nolock()) ffff9746022e5800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1784938802.287430:0:33359:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff974609e88000) has no exports 00000100:00100000:0.0:1784938802.287430:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342566272:192.168.202.104@tcp:9:umount.0 00010000:00010000:3.0:1784938802.287600:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938802.287607:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938802.287642:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342566144 00000100:00100000:3.0:1784938802.287649:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342566144 00000100:00100000:0.0:1784938802.287685:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938802.287714:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342566272 00000100:00100000:3.0:1784938802.287718:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342566272 00000100:00100000:1.0:1784938802.288686:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342566016:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1784938802.289929:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938802.289936:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:2.0:1784938802.290008:0:33359:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff974609e88000) has no exports 00000100:00100000:0.0:1784938802.290568:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 172 00000100:00100000:0.0:1784938802.290584:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12801:x1871643342566144:12345-192.168.202.104@tcp:9:umount.0 00000020:00000080:0.0:1784938802.290612:0:33065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06d68 00000100:00080000:0.0:1784938802.290621:0:33065:0:(import.c:65:import_set_state_nolock()) ffff9746022e7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938802.290705:0:33065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967346 00000100:00100000:0.0:1784938802.291073:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:12801:x1871643342566144:12345-192.168.202.104@tcp:9:umount.0 Request processed in 495us (3465us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938802.291092:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 172 00000100:00100000:0.0:1784938802.291120:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 173 00000100:00100000:0.0:1784938802.291127:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12801:x1871643342566272:12345-192.168.202.104@tcp:9:umount.0 00000020:00000080:0.0:1784938802.291138:0:33065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06e4f 00000100:00080000:0.0:1784938802.291205:0:33065:0:(import.c:65:import_set_state_nolock()) ffff9747360ad800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784938802.291599:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1784938802.291679:0:33065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967346 00000100:00100000:0.0:1784938802.291923:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:12801:x1871643342566272:12345-192.168.202.104@tcp:9:umount.0 Request processed in 783us (4224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938802.291931:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 173 00000100:00080000:0.0:1784938802.292388:0:12801:0:(import.c:65:import_set_state_nolock()) ffff9746022e5800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784938802.292411:0:12801:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784938802.292414:0:12801:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938802.292419:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342566272:192.168.202.104@tcp:9:umount.0 00000100:00080000:0.0:1784938802.292447:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974607a56800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784938802.292454:0:12801:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784938802.292455:0:12801:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938802.292458:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342566144:192.168.202.104@tcp:9:umount.0 00010000:00010000:1.0:1784938802.292920:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784938802.352678:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06c2d 00000020:00000080:2.0:1784938802.352704:0:33359:0:(genops.c:906:class_export_put()) final put ffff974706228000/lustre-QMT0000_UUID 00000020:01000000:2.0:1784938802.352729:0:33359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1784938802.352878:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974706228000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1784938802.352907:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938802.352917:0:33359:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784938802.352922:0:33359:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9747366819c0) has no exports 00000020:00000080:0.0:1784938802.354010:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06c26 00000020:00000080:0.0:1784938802.354018:0:33359:0:(genops.c:906:class_export_put()) final put ffff9747101c6800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784938802.354116:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938802.354127:0:33359:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784938802.354130:0:33359:0:(genops.c:906:class_export_put()) final put ffff974718ae3000/lustre-QMT0000_UUID 00000020:00000080:0.0:1784938802.354133:0:33359:0:(genops.c:865:class_export_destroy()) destroying export ffff974718ae3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1784938802.354139:0:33359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1784938802.355582:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff9747101c6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1784938802.355704:0:33359:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff974735aef720 - data ffff974608291870/ffff974708e69400 00000020:01000000:0.0:1784938802.355898:0:33359:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff974718234e40 - data ffff97472c554a20/ffff974734c8b800 00000001:00000004:1.0:1784938802.384610:0:33359:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967565 00010000:00010000:3.0:1784938802.487789:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784938802.503458:0:33359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784938802.503465:0:33359:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967319 gen 4 00000004:00080000:0.0:1784938802.503497:0:33359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938802.503501:0:33359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784938802.504548:0:31526:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784938802.504553:0:31526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1784938802.504564:0:31526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1784938802.510549:0:33359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784938802.510559:0:33359:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967319 gen 4 00000004:00080000:0.0:1784938802.510593:0:33359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938802.510597:0:33359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784938802.510902:0:32342:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784938802.510908:0:32342:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1784938802.510919:0:32342:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1784938802.635747:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06bf5 00000020:00000080:3.0:1784938802.635780:0:33359:0:(genops.c:906:class_export_put()) final put ffff974710dca000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784938802.635817:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974710dca000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784938802.636632:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06c0a 00000020:00000080:3.0:1784938802.636639:0:33359:0:(genops.c:906:class_export_put()) final put ffff9747099e4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784938802.636650:0:33359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1784938802.636658:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938802.636666:0:33359:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784938802.636684:0:33359:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff974609e8b380) has no exports 00000020:00000080:2.0:1784938802.636735:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff9747099e4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1784938802.636868:0:33359:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1784938802.636878:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06e48 00000020:00000080:3.0:1784938802.636883:0:33359:0:(genops.c:906:class_export_put()) final put ffff97471d977800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784938802.636894:0:33359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784938802.636898:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938802.636906:0:33359:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784938802.636909:0:33359:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff974602f60000) has no exports 00000020:00000080:2.0:1784938802.636912:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff97471d977800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784938802.636915:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06e41 00000020:00000080:3.0:1784938802.636922:0:33359:0:(genops.c:906:class_export_put()) final put ffff9746022e6800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784938802.636939:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff9746022e6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1784938802.641307:0:33359:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784938802.641316:0:33359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784938802.641321:0:33359:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967319 gen 5 00000004:00080000:3.0:1784938802.641330:0:33359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938802.641332:0:33359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784938802.641383:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938802.641398:0:33359:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938802.641408:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06d61 00000020:00000080:3.0:1784938802.641417:0:33359:0:(genops.c:906:class_export_put()) final put ffff9747102a9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784938802.641424:0:33359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784938802.641431:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938802.641437:0:33359:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784938802.641440:0:33359:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9747034a8000) has no exports 00000020:00000080:3.0:1784938802.641448:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06d5a 00000020:00000080:3.0:1784938802.641451:0:33359:0:(genops.c:906:class_export_put()) final put ffff974607a51000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784938802.641504:0:24411:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9746022e5800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1784938802.641514:0:24411:0:(genops.c:906:class_export_put()) final put ffff974736362000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784938802.641517:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974736362000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1784938802.641525:0:24411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938802.641624:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff9747102a9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1784938802.641632:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974607a51000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1784938802.641959:0:33359:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784938802.641963:0:33359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784938802.641965:0:33359:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967319 gen 5 00000004:00080000:3.0:1784938802.641969:0:33359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938802.641971:0:33359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784938802.642007:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938802.642013:0:33359:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938802.642064:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938802.642068:0:33359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938802.642071:0:33359:0:(genops.c:906:class_export_put()) final put ffff974703e9c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938802.642074:0:33359:0:(genops.c:865:class_export_destroy()) destroying export ffff974703e9c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784938802.642089:0:33359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938802.642164:0:24411:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974607a56800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1784938802.642172:0:24411:0:(genops.c:906:class_export_put()) final put ffff9746020c9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784938802.642174:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff9746020c9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1784938802.642181:0:24411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938802.642227:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06c11 00000020:00000080:3.0:1784938802.642233:0:33359:0:(genops.c:906:class_export_put()) final put ffff9747099e1800/lustre-MDD0000_UUID 00000020:01000000:3.0:1784938802.642250:0:33359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1784938802.642254:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938802.642258:0:33359:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784938802.642261:0:33359:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff974609e8cd40) has no exports 00000020:00000080:2.0:1784938802.642264:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff9747099e1800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1784938802.642284:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938802.642288:0:33359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1784938802.642291:0:33359:0:(genops.c:906:class_export_put()) final put ffff9747099e2000/lustre-MDD0000_UUID 00000020:00000080:3.0:1784938802.642294:0:33359:0:(genops.c:865:class_export_destroy()) destroying export ffff9747099e2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1784938802.642299:0:33359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1784938802.642391:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06c18 00000020:00000080:3.0:1784938802.642396:0:33359:0:(genops.c:906:class_export_put()) final put ffff9747099e2800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784938802.642414:0:33359:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9747294ad000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1784938802.642418:0:33359:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9747294ad000 3 00000020:01000004:3.0:1784938802.642422:0:33359:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9747294ad000 from lustre-MDT0000 00000020:00000080:0.0:1784938802.642428:0:12700:0:(genops.c:865:class_export_destroy()) destroying export ffff9747099e2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784938802.642444:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938802.642449:0:33359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1784938802.642452:0:33359:0:(genops.c:906:class_export_put()) final put ffff974710dc9000/lustre-MDT0000_UUID 00000020:00000080:3.0:1784938802.642454:0:33359:0:(genops.c:865:class_export_destroy()) destroying export ffff974710dc9000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1784938802.642460:0:33359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1784938802.642497:0:33359:0:(obd_mount.c:574:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1784938802.642501:0:33359:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1784938802.642504:0:33359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1784938802.642506:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938802.642509:0:33359:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784938802.642516:0:33359:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff974736694800 754ce9ff-680f-4784-b8fd-fa933d4638f3 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784938802.642527:0:33359:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff974736680000) has exports, disconnecting them 00000020:00080000:3.0:1784938802.642531:0:33359:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff974736694800), last request at 1784938721 00000020:00000080:3.0:1784938802.642545:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06bb6 00000020:00010000:3.0:1784938802.642549:0:33359:0:(genops.c:1942:obd_stale_export_put()) Put export ffff974736694800: total 0 00000100:00080000:3.0:1784938802.642552:0:33359:0:(import.c:65:import_set_state_nolock()) ffff974736696000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784938802.642571:0:33359:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff974736694800): rc 0 00000020:00080000:3.0:1784938802.642575:0:33359:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff974736680000) has no exports 00000100:00100000:3.0:1784938802.642633:0:30625:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff974609efe000:30625] 2 exiting: rc = 0 00000100:00100000:0.0:1784938802.642668:0:30624:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff974718a74e00:30624] 1 exiting: rc = 0 00000100:00100000:3.0:1784938802.642730:0:30623:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff974705682c00:30623] 0 exiting: rc = 1 00000100:00100000:3.0:1784938802.642805:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642813:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642819:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642826:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642835:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642841:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:2.0:1784938802.642845:0:30619:0:(genops.c:1928:obd_stale_export_get()) Get export ffff974736694800: total 0 00000100:00100000:3.0:1784938802.642852:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642860:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642866:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642877:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784938802.642878:0:30619:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff974736694800, canceled 0 locks, left on hash table 8. 00000100:00100000:3.0:1784938802.642886:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642892:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642899:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642904:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642909:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642914:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784938802.642920:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460924e400/0xcd9d312a94a06dd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a06dca expref: 9 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938802.642922:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642932:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642942:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784938802.642944:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974741e00e00/0xcd9d312a94a06e5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a06e56 expref: 8 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938802.642950:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642958:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642969:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784938802.642973:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609397c00/0xcd9d312a94a06dfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a06df4 expref: 7 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938802.642979:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.642990:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643006:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643011:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643017:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643023:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643029:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643035:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643041:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643047:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643052:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643058:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643064:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643070:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643086:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643093:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643099:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643105:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643111:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643117:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643123:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643129:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643135:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643140:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643147:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643152:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643158:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643165:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643171:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643177:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643182:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643188:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643195:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643203:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784938802.643208:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609396600/0xcd9d312a94a06cce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a06cc7 expref: 6 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938802.643216:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643225:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643233:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784938802.643249:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609397a00/0xcd9d312a94a06e09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a06e02 expref: 5 pid: 30625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938802.643250:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643261:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784938802.643271:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97470148a200/0xcd9d312a94a07285 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a07269 expref: 4 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938802.643272:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.643283:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784938802.643293:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609397800/0xcd9d312a94a06da7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a06da0 expref: 3 pid: 30623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938802.643295:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1784938802.643316:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97470148bc00/0xcd9d312a94a07293 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a0728c expref: 2 pid: 30624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938802.643334:0:30619:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff974736694800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1784938802.643356:0:30619:0:(genops.c:906:class_export_put()) final put ffff974736694800/754ce9ff-680f-4784-b8fd-fa933d4638f3 00010000:00010000:2.0:1784938802.643408:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938802.643412:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938802.643416:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1784938802.643681:0:33359:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784938802.643684:0:33359:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1784938802.645782:0:12700:0:(genops.c:865:class_export_destroy()) destroying export ffff974736694800/754ce9ff-680f-4784-b8fd-fa933d4638f3 for MGS 00000020:00000080:0.0:1784938802.645829:0:12700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974736696000 for MGS 00000020:01000000:3.0:1784938802.653898:0:33359:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff974703f55300 - data ffff97473fdcd870/ffff974735ad3800 00000020:01000000:3.0:1784938802.654846:0:33359:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff974718a62c60 - data ffff97471e0356c0/ffff97473a301c00 00000020:00000080:3.0:1784938802.656228:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06b9a 00000020:00000080:3.0:1784938802.656236:0:33359:0:(genops.c:906:class_export_put()) final put ffff974609ce9800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784938802.656292:0:33359:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9747294ad000 from MGS, refs=2 00000020:01000004:3.0:1784938802.656303:0:33359:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9747294ad000 2 00000020:01000004:3.0:1784938802.656307:0:33359:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9747294ad000 from MGS 00000020:00000080:3.0:1784938802.656329:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938802.656336:0:33359:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1784938802.656338:0:33359:0:(genops.c:906:class_export_put()) final put ffff974710717800/MGS 00000020:00000080:3.0:1784938802.656341:0:33359:0:(genops.c:865:class_export_destroy()) destroying export ffff974710717800/MGS for MGS 00000020:01000000:3.0:1784938802.656348:0:33359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1784938802.656403:0:33359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1784938802.656407:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938802.656412:0:33359:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784938802.656420:0:33359:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff974736695000 lustre-MDT0000-lwp-MDT0000 192.168.202.104@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784938802.656426:0:33359:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9747034acd40) has exports, disconnecting them 00000020:00080000:3.0:1784938802.656432:0:33359:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 192.168.202.104@tcp (ffff974736695000), last request at 1784938722 00000020:00000080:3.0:1784938802.656436:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06c65 00000020:00080000:3.0:1784938802.656447:0:33359:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.104@tcp (ffff974736695000): rc 0 00000020:00000080:3.0:1784938802.656451:0:33359:0:(genops.c:906:class_export_put()) final put ffff974736695000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1784938802.658988:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974609ce9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784938802.666197:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974736695000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1784938802.666819:0:33359:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1784938802.666825:0:33359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784938802.666830:0:33359:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784938802.666836:0:33359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784938802.667008:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938802.667018:0:33359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1784938802.667025:0:33359:0:(obd_mount.c:706:lustre_put_lsi()) put ffff9747294ad000 1 00000020:00000080:2.0:1784938802.667048:0:33359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a06b8c 00000020:00000080:2.0:1784938802.667056:0:33359:0:(genops.c:906:class_export_put()) final put ffff974710712800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1784938802.667062:0:33359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1784938802.667066:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938802.667070:0:33359:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784938802.667074:0:33359:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff974609e899c0) has no exports 00000020:00000080:0.0:1784938802.667523:0:24411:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974601dd3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784938802.667530:0:24411:0:(genops.c:906:class_export_put()) final put ffff974601dd3800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784938802.667532:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974601dd3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784938802.667540:0:24411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1784938802.667596:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974710712800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784938802.713378:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938802.713394:0:33359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1784938802.713401:0:33359:0:(genops.c:906:class_export_put()) final put ffff9747294ad800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784938802.713405:0:33359:0:(genops.c:865:class_export_destroy()) destroying export ffff9747294ad800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1784938802.713416:0:33359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1784938802.715352:0:33359:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffff9747294a9800 00000020:01000000:0.0:1784938802.715383:0:33359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1784938802.715388:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938802.715393:0:33359:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784938802.715397:0:33359:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9747034ab380) has no exports 00000100:00100000:3.0:1784938802.716361:0:33061:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff974704c6b600:33061] 3 exiting: rc = 0 00000100:00100000:0.0:1784938802.716629:0:30631:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff974735b5f800:30631] 1 exiting: rc = 0 00000100:00100000:1.0:1784938802.717136:0:30630:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9747062e7200:30630] 0 exiting: rc = 1 00000100:00100000:1.0:1784938802.717197:0:30632:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff974735b5fa00:30632] 2 exiting: rc = 0 00000100:00100000:0.0:1784938802.717587:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717597:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717603:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717609:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717615:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717622:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717629:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717634:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717639:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717644:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717650:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717802:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717811:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717816:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717822:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717829:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717847:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717852:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717858:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717865:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717870:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717875:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717881:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717886:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717892:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717898:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717904:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717910:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717915:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717921:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717927:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717933:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717938:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717943:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717949:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717954:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717959:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717964:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717969:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717975:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717982:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.717987:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718747:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718771:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718777:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718783:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718788:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718793:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718798:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718803:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718808:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718825:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718832:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718838:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718855:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718862:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718867:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718873:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718892:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718897:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718902:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718908:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718915:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.718923:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938802.734203:0:30633:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff974735b5e400:30633] 0 exiting: rc = 1 00000100:00100000:3.0:1784938802.734317:0:30634:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff974735b5f000:30634] 1 exiting: rc = 0 00000100:00100000:2.0:1784938802.734415:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.734425:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.734591:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.734601:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.734608:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.734613:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.734619:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.734624:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.734629:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.734634:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.734640:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.734645:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.734651:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736020:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736029:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736035:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736041:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736046:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736051:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736056:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736062:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736068:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736073:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736089:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736094:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736099:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736104:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736108:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736113:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736131:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736137:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736143:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736148:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736153:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736158:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736163:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736168:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736173:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736178:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736182:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736187:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736191:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736197:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736202:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736207:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736212:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736217:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736221:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736226:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736231:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736236:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736240:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736245:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736250:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736254:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736259:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736264:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736269:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736274:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736279:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736284:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736288:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736293:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.736299:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.736838:0:30635:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9747099d2000:30635] 0 exiting: rc = 1 00000100:00100000:1.0:1784938802.738325:0:30636:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9747099d3400:30636] 1 exiting: rc = 0 00000100:00100000:0.0:1784938802.738523:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738531:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738571:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738578:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738583:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738589:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738594:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738599:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738605:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738611:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738616:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738632:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738639:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738645:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738650:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738656:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738662:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738668:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738674:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738679:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738685:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738702:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738708:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738728:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738738:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738744:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738767:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738777:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738784:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738793:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738800:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738809:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738816:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738824:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738833:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738863:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738875:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738883:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738891:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738900:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738910:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738919:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738928:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738936:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738945:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738954:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.738963:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.739069:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.739088:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.739094:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.739101:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.739107:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.739114:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.739120:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.739127:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.739133:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.740355:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.740360:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.740366:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.740397:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.740404:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.740410:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.740417:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.740431:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762499:0:30638:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9747103fd800:30638] 1 exiting: rc = 0 00000100:00100000:2.0:1784938802.762809:0:30637:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff97470313d000:30637] 0 exiting: rc = 1 00000100:00100000:0.0:1784938802.762917:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762925:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762930:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762936:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762943:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762948:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762953:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762959:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762964:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762968:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762973:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762978:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762984:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.762989:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763004:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763010:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763015:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763020:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763025:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763029:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763034:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763039:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763044:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763049:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763055:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763060:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763094:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763099:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763104:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763110:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763115:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763120:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763125:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763130:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763135:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763139:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763144:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763150:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763154:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763159:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763164:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763169:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763174:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763179:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763184:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763190:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763194:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763200:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763204:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763208:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763213:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763218:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763222:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763227:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763231:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763237:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763242:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763246:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763250:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763255:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763259:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763272:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763277:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.763283:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.771597:0:30640:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9746026fe400:30640] 1 exiting: rc = 0 00000100:00100000:2.0:1784938802.771938:0:30639:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9746026ff200:30639] 0 exiting: rc = 1 00000100:00100000:0.0:1784938802.772118:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772126:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772131:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772136:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772141:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772147:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772152:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772157:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772164:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772168:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772174:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772179:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772184:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772189:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772195:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772200:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772204:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772210:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772215:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772220:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772225:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772230:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772236:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772241:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772246:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772250:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772254:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772259:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772263:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772268:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772274:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772298:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772303:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772308:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772312:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772317:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772323:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772328:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772335:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772339:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772345:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772350:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772356:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772361:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772366:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772372:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772378:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772384:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772389:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772394:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772399:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772404:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772408:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772414:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772419:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772424:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772429:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772434:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772439:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772443:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772448:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772453:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772458:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.772463:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938802.773141:0:30642:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9746026fe800:30642] 1 exiting: rc = 0 00000100:00100000:1.0:1784938802.775578:0:30641:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9746026fec00:30641] 0 exiting: rc = 1 00000100:00100000:0.0:1784938802.775792:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775800:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775820:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775825:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775831:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775835:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775840:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775845:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775851:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775855:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775860:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775865:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775871:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775875:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775881:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775886:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775891:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775896:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775901:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775906:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775911:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775916:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775921:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775926:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775932:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775937:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775942:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775947:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775952:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775957:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775962:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775968:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775973:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775978:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775983:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.775988:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776291:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776305:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776311:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776315:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776319:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776324:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776329:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776334:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776339:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776344:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776349:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776355:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776360:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776365:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776370:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776374:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776379:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776383:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776388:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776393:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776398:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776404:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776409:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776413:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776418:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776423:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776428:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.776433:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938802.790094:0:30644:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9746026fe600:30644] 1 exiting: rc = 0 00000100:00100000:1.0:1784938802.790324:0:30645:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff974701341e00:30645] 2 exiting: rc = 0 00000100:00100000:0.0:1784938802.791059:0:30643:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9746026fee00:30643] 0 exiting: rc = 1 00000100:00100000:0.0:1784938802.792275:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792284:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792290:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792296:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792301:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792307:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792312:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792334:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792339:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792345:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792350:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792355:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792361:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792367:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792373:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792379:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792385:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792391:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792397:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792403:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792409:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792415:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792437:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792444:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792449:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792454:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792459:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792465:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.792473:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793155:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793165:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793171:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793176:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793181:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793187:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793192:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793197:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793204:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793210:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793216:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793221:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793225:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793242:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793247:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793252:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793257:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793279:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793287:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793292:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793298:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793303:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793309:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793314:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793320:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793326:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793332:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793337:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793343:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793349:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793356:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793362:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793374:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793383:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938802.793389:0:33359:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784938802.801110:0:33359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938802.801125:0:33359:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1784938802.801130:0:33359:0:(genops.c:906:class_export_put()) final put ffff974710dce000/MDS_uuid 00000020:00000080:0.0:1784938802.801136:0:33359:0:(genops.c:865:class_export_destroy()) destroying export ffff974710dce000/MDS_uuid for MDS 00000020:01000000:0.0:1784938802.801142:0:33359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1784938802.801269:0:33359:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1784938803.508048:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784938803.620431:0:31424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784938803.620440:0:31424:0:(genops.c:906:class_export_put()) final put ffff9746022e7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784938803.620470:0:12700:0:(genops.c:865:class_export_destroy()) destroying export ffff9746022e7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784938803.627402:0:12700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9746022e7000 for lustre-OST0000 00010000:00010000:3.0:1784938804.535275:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938805.556683:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938805.619269:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938805.619289:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342566400:0@lo:400:kworker.0 00000400:00000100:3.0:1784938805.619352:0:12804:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643342566400 offset 0 length 224: 4 00000100:00100000:0.0:1784938805.620101:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342566656:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938805.620213:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938805.620221:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:12803:1871643342566528:192.168.202.104@tcp:400:kworker.0 00000400:00000100:3.0:1784938805.622216:0:12796:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.104@tcp portal 12 match 1871643342566656 offset 0 length 224: 4 00000400:00000100:3.0:1784938805.622281:0:12796:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.104@tcp portal 12 match 1871643342566528 offset 0 length 224: 4 00000001:00100000:1.0:1784938805.655904:0:32270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938805.655913:0:32270:0:(genops.c:906:class_export_put()) final put ffff9747360ae000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938805.655978:0:12700:0:(genops.c:865:class_export_destroy()) destroying export ffff9747360ae000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1784938805.656028:0:12700:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9747360ad800 for lustre-OST0001 00010000:00010000:1.0:1784938806.579469:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938807.605658:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938808.628080:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938809.658916:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938810.682943:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938810.741813:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342566912:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938810.741917:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938810.741924:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342566784:0@lo:400:kworker.0 00000400:00000100:1.0:1784938810.741950:0:12805:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643342566784 offset 0 length 224: 4 00000100:00100000:1.0:1784938810.742001:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342567040:192.168.202.104@tcp:400:kworker.0 00000400:00000100:1.0:1784938810.742170:0:12795:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.104@tcp portal 12 match 1871643342566912 offset 0 length 224: 4 00000400:00000100:1.0:1784938810.742255:0:12795:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.104@tcp portal 12 match 1871643342567040 offset 0 length 224: 4 00000020:01000004:3.0:1784938811.335485:0:33790:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:3.0:1784938811.335493:0:33790:0:(obd_mount.c:922:lmd_print()) device: lustre-mdt1/mdt1 00000020:01000004:3.0:1784938811.335495:0:33790:0:(obd_mount.c:925:lmd_print()) options: user_xattr 00000080:01200004:3.0:1784938811.336533:0:33790:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff974607ca0800 00000020:01000004:3.0:1784938811.336558:0:33790:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1784938811.336575:0:33790:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784938811.336597:0:33790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff974708c5b380) 00000020:00000080:3.0:1784938811.336619:0:33790:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784938811.445642:0:33790:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1784938811.462708:0:33790:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1784938811.467718:0:33790:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784938811.468161:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 433: rc = 0 00100000:10000000:2.0:1784938811.468313:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 433: rc = 0 00100000:10000000:2.0:1784938811.468558:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 433: rc = 0 00100000:10000000:2.0:1784938811.468651:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 433: rc = 0 00100000:10000000:2.0:1784938811.469579:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 433: rc = 0 00100000:10000000:2.0:1784938811.469690:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 433: rc = 0 00100000:10000000:2.0:1784938811.472187:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 435: rc = 0 00100000:10000000:0.0:1784938811.497413:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:0.0:1784938811.497538:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:0.0:1784938811.508259:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:0.0:1784938811.510611:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:2.0:1784938811.555180:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1784938811.562354:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1784938811.575371:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1784938811.586497:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:1.0:1784938811.591680:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 645: rc = 0 00100000:10000000:1.0:1784938811.599285:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 645: rc = 0 00100000:10000000:1.0:1784938811.614525:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 645: rc = 0 00100000:10000000:0.0:1784938811.620466:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 645: rc = 0 00100000:10000000:0.0:1784938811.622251:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 645: rc = 0 00100000:10000000:0.0:1784938811.623593:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 645: rc = 0 00100000:10000000:0.0:1784938811.634533:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 204: rc = 0 00100000:10000000:0.0:1784938811.638222:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 204: rc = 0 00100000:10000000:0.0:1784938811.640399:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 204: rc = 0 00100000:10000000:1.0:1784938811.648164:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 204: rc = 0 00100000:10000000:1.0:1784938811.660452:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 204: rc = 0 00100000:10000000:1.0:1784938811.670186:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 204: rc = 0 00100000:10000000:1.0:1784938811.680442:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 204: rc = 0 00100000:10000000:1.0:1784938811.685621:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 204: rc = 0 00100000:10000000:2.0:1784938811.695533:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 204: rc = 0 00100000:10000000:2.0:1784938811.698556:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 204: rc = 0 00010000:00010000:3.0:1784938811.700378:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1784938811.710486:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 204: rc = 0 00100000:10000000:2.0:1784938811.713405:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 204: rc = 0 00100000:10000000:2.0:1784938811.715446:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 204: rc = 0 00100000:10000000:2.0:1784938811.717536:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 204: rc = 0 00100000:10000000:2.0:1784938811.724166:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 204: rc = 0 00100000:10000000:2.0:1784938811.725695:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 204: rc = 0 00100000:10000000:2.0:1784938811.728618:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 204: rc = 0 00100000:10000000:2.0:1784938811.730408:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 204: rc = 0 00100000:10000000:2.0:1784938811.734196:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 204: rc = 0 00100000:10000000:2.0:1784938811.736539:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 204: rc = 0 00100000:10000000:2.0:1784938811.739248:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 204: rc = 0 00100000:10000000:2.0:1784938811.740703:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 204: rc = 0 00100000:10000000:2.0:1784938811.742704:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 204: rc = 0 00100000:10000000:2.0:1784938811.744484:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 204: rc = 0 00100000:10000000:2.0:1784938811.746258:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 204: rc = 0 00100000:10000000:2.0:1784938811.748689:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 204: rc = 0 00100000:10000000:0.0:1784938811.750722:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 204: rc = 0 00100000:10000000:0.0:1784938811.753127:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 204: rc = 0 00100000:10000000:0.0:1784938811.758270:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 204: rc = 0 00100000:10000000:0.0:1784938811.763568:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 204: rc = 0 00100000:10000000:0.0:1784938811.777700:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 204: rc = 0 00100000:10000000:2.0:1784938811.791316:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 204: rc = 0 00100000:10000000:0.0:1784938811.810012:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 549: rc = 0 00100000:10000000:1.0:1784938811.814359:0:33790:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1784938811.815590:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:1.0:1784938811.820350:0:33790:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1784938811.820598:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:1.0:1784938811.823140:0:33790:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1784938811.827530:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:1.0:1784938811.834721:0:33790:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1784938811.835206:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:1.0:1784938811.837597:0:33790:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1784938811.837724:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:2.0:1784938811.843191:0:33790:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1784938811.843421:0:33790:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00000020:00000080:2.0:1784938811.844302:0:33790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784938811.844315:0:33790:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784938811.844329:0:33790:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a09141 00000020:01000004:2.0:1784938811.844341:0:33790:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1784938811.844353:0:33790:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1784938811.844424:0:33790:0:(tgt_mount.c:101:server_register_mount()) register mount ffff974607ca0800 from MGS 00000020:01000004:2.0:1784938811.844430:0:33790:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1784938811.844445:0:33790:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff974707f2cd40) 00000020:00000080:2.0:1784938811.844459:0:33790:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1784938811.844537:0:33790:0:(tgt_mount.c:153:server_get_mount()) get mount ffff974607ca0800 from MGS, refs=2 00080000:01000000:2.0:1784938811.844544:0:33790:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784938811.844549:0:33790:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a0914f 00010000:00010000:2.0:1784938811.844703:0:33790:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:2.0:1784938811.914333:0:33790:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1784938811.914431:0:33790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784938811.914435:0:33790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1784938811.929640:0:33791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1784938811.940791:0:33790:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1784938811.945985:0:33790:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784938811.963345:0:33790:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784938811.964312:0:33790:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938811.965464:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784938811.965474:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784938811.968556:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784938811.968574:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1784938811.971183:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1784938811.971198:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1784938811.972604:0:33790:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784938811.972642:0:33790:0:(obd_mount.c:395:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1784938811.972644:0:33790:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1784938811.972649:0:33790:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:2.0:1784938811.972663:0:33790:0:(import.c:65:import_set_state_nolock()) ffff974736697800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1784938811.972669:0:33790:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1784938811.991577:0:33790:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.104@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1784938811.991585:0:33790:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1784938811.991599:0:33790:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff974602fb6a00 x1871643342566400/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784938821 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938811.991703:0:33790:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff974603681f80 x1871643342566784/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784938826 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784938811.991736:0:33790:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784938811.991740:0:33790:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784938811.991742:0:33790:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1784938811.991746:0:33790:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1784938811.993414:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342566784:0@lo:400:kworker.0 00000100:00100000:3.0:1784938811.998353:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342566400:0@lo:400:kworker.0 10000000:01000000:2.0:1784938811.998421:0:33790:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1784938811.998646:0:33790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974741e00c00/0xcd9d312a94a06cc7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a06cce expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938811.998661:0:33790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974741e00c00/0xcd9d312a94a06cc7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a06cce expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938811.998669:0:33790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784938811.998732:0:33790:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784938811.998745:0:33790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974741e00c00/0xcd9d312a94a06cc7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a06cce expref: -99 pid: 31422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938811.998811:0:33790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a06da7 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938811.998819:0:33790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a06da7 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938811.998824:0:33790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938812.000106:0:33790:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784938812.000119:0:33790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974735f29800/0xcd9d312a94a06da0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a06da7 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.000137:0:33790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974735f28c00/0xcd9d312a94a06dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a06dd1 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938812.000144:0:33790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974735f28c00/0xcd9d312a94a06dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a06dd1 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938812.000150:0:33790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938812.000297:0:33790:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938812.000305:0:33790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974735f28c00/0xcd9d312a94a06dca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a06dd1 expref: -99 pid: 32268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.000340:0:33790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a06df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a06dfb expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938812.000347:0:33790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a06df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a06dfb expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938812.000353:0:33790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938812.000358:0:33790:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938812.000361:0:33790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a06df4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a06dfb expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.000369:0:33790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974609397000/0xcd9d312a94a06e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a06e09 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938812.000375:0:33790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974609397000/0xcd9d312a94a06e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a06e09 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938812.000380:0:33790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938812.000383:0:33790:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938812.000385:0:33790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974609397000/0xcd9d312a94a06e02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a06e09 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.000393:0:33790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460924f600/0xcd9d312a94a06e56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a06e5d expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938812.000399:0:33790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460924f600/0xcd9d312a94a06e56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a06e5d expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938812.000404:0:33790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938812.000414:0:33790:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938812.000419:0:33790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460924f600/0xcd9d312a94a06e56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a06e5d expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.000451:0:33790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974700031600/0xcd9d312a94a07269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a07285 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938812.000458:0:33790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974700031600/0xcd9d312a94a07269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a07285 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938812.000463:0:33790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938812.000467:0:33790:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938812.000470:0:33790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974700031600/0xcd9d312a94a07269 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a07285 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.000479:0:33790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974741e01c00/0xcd9d312a94a0728c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a07293 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938812.000485:0:33790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974741e01c00/0xcd9d312a94a0728c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a07293 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938812.000491:0:33790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938812.000494:0:33790:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1784938812.000497:0:33790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974741e01c00/0xcd9d312a94a0728c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a07293 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784938812.000520:0:33790:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff974736697800 already not connected (conn 1, was 0): DISCONN 00000100:00080000:3.0:1784938812.000528:0:33790:0:(import.c:65:import_set_state_nolock()) ffff974736697800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938812.000537:0:33790:0:(import.c:510:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 875 00000100:00080000:3.0:1784938812.000546:0:33790:0:(import.c:624:import_select_connection()) MGC192.168.202.104@tcp: import ffff974736697800 using connection 754ce9ff-680f-4784-b8fd-fa933d4638f3/0@lo 00000100:00100000:3.0:1784938812.000599:0:33790:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974602fb6a00 x1871643342567168/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938812.000630:0:33790:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1784938812.004272:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:754ce9ff-680f-4784-b8fd-fa933d4638f3:12801:1871643342567168:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784938812.004375:0:12801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938812.004571:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342567168 00000100:00100000:1.0:1784938812.004583:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342567168 00000100:00100000:1.0:1784938812.004631:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784938812.004643:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:12801:x1871643342567168:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1784938812.004674:0:33793:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from 754ce9ff-680f-4784-b8fd-fa933d4638f3@0@lo t0 exp 0000000000000000 cur 965 last 0 00000020:00000080:1.0:1784938812.004705:0:33793:0:(genops.c:1406:class_connect()) connect: client 754ce9ff-680f-4784-b8fd-fa933d4638f3, cookie 0xcd9d312a94a09156 00000100:00080000:1.0:1784938812.005125:0:33793:0:(import.c:65:import_set_state_nolock()) ffff974601254000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938812.005190:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+5:12801:x1871643342567168:12345-0@lo:250:mount.lustre.0 Request processed in 546us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938812.005196:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784938812.005610:0:12801:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.104@tcp: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784938812.005620:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.104@tcp: connect to target with instance 0 00000100:00080000:2.0:1784938812.005629:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784938812.005634:0:12801:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784938812.005637:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974736697800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784938812.005639:0:12801:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784938812.005665:0:12801:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784938812.005675:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:754ce9ff-680f-4784-b8fd-fa933d4638f3:12801:1871643342567168:0@lo:250:mount.lustre.0 00000020:01000000:3.0:1784938812.005795:0:24411:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.104@tcp 10000000:01000000:3.0:1784938812.005813:0:24411:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1784938812.005816:0:24411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1784938812.005818:0:24411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784938812.005819:0:24411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938812.005820:0:24411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938812.005821:0:24411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938812.005822:0:24411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938812.005823:0:24411:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938812.005825:0:24411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938812.005826:0:24411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1784938812.006035:0:24411:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1784938812.006043:0:24411:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1784938812.006045:0:24411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1784938812.006046:0:24411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938812.006047:0:24411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938812.006049:0:24411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938812.006050:0:24411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938812.006051:0:24411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938812.006052:0:24411:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938812.006053:0:24411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938812.006055:0:24411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1784938812.006092:0:24411:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1784938812.006121:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342567424:0@lo:253:kworker.0 00000100:00100000:3.0:1784938812.006159:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784938812.006202:0:33790:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1784938812.006212:0:33790:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1784938812.006218:0:33790:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1784938812.006237:0:33790:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff974609e899c0) 00000020:00000080:3.0:1784938812.006252:0:33790:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1784938812.007193:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342567296:0@lo:253:kworker.0 00000100:00100000:2.0:1784938812.007241:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938812.010235:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342567424 00000100:00100000:1.0:1784938812.010255:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342567424 00000100:00100000:1.0:1784938812.010321:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342567296 00000100:00100000:1.0:1784938812.010325:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342567296 00000100:00100000:1.0:1784938812.010347:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784938812.010357:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:12804:x1871643342567424:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784938812.010402:0:33793:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:1.0:1784938812.010632:0:33796:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784938812.011154:0:33793:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 00000100:00100000:3.0:1784938812.013456:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784938812.013479:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:12803:x1871643342567296:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1784938812.013542:0:33794:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:1.0:1784938812.035711:0:33790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938812.036355:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784938812.036364:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1784938812.049181:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1784938812.049205:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 20000000:01000000:0.0:1784938812.049543:0:33799:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1784938812.049550:0:33799:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1784938812.049561:0:33799:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1784938812.049642:0:33799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:3.0:1784938812.050421:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1784938812.050430:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 20000000:01000000:0.0:1784938812.050674:0:33793:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784938812.050748:0:33794:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784938812.061923:0:33790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938812.062161:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784938812.062170:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1784938812.067182:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1784938812.067202:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1784938812.160075:0:33790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938812.160296:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1784938812.160304:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1784938812.168445:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1784938812.168459:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1784938812.176563:0:33790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938812.176790:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784938812.176797:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1784938812.178150:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784938812.178160:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1784938812.178601:0:33790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938812.178846:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784938812.178852:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784938812.179583:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784938812.179590:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784938812.180254:0:33790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938812.180386:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784938812.180391:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784938812.183441:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784938812.183459:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 20000000:01000000:2.0:1784938812.183623:0:33794:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784938812.183633:0:33794:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1784938812.183651:0:33796:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784938812.183654:0:33796:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784938812.183679:0:33796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff974609c46c00/0xcd9d312a94a09164 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.183695:0:33796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609c46c00/0xcd9d312a94a09164 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784938812.183704:0:33796:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000050439s 00010000:00010000:2.0:1784938812.183709:0:33796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974609c46c00/0xcd9d312a94a09164 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.183716:0:33796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974609c46c00/0xcd9d312a94a09164 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.183739:0:33796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff974609c46c00/0xcd9d312a94a09164 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.183747:0:33796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff974609c46c00/0xcd9d312a94a09164 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.183767:0:33796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938812.183771:0:33796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff974609c46c00/0xcd9d312a94a09164 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.183780:0:33796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff974609c46c00/0xcd9d312a94a09164 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.183792:0:33796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff974609c46c00/0xcd9d312a94a09164 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.183800:0:33796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff974609c46c00/0xcd9d312a94a09164 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.183807:0:33796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609c46c00/0xcd9d312a94a09164 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938812.189493:0:33793:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784938812.260878:0:33790:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938812.261119:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784938812.261126:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 20000000:01000000:2.0:1784938812.263889:0:33793:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784938812.263912:0:33793:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1784938812.264007:0:33796:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784938812.264019:0:33796:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784938812.264068:0:33796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff974742045200/0xcd9d312a94a0916b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.264090:0:33796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974742045200/0xcd9d312a94a0916b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784938812.264102:0:33796:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000084810s 00010000:00010000:3.0:1784938812.264108:0:33796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974742045200/0xcd9d312a94a0916b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.264115:0:33796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974742045200/0xcd9d312a94a0916b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.264122:0:33796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff974742045200/0xcd9d312a94a0916b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.264131:0:33796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff974742045200/0xcd9d312a94a0916b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.264139:0:33796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938812.264145:0:33796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff974742045200/0xcd9d312a94a0916b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.264176:0:33796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff974742045200/0xcd9d312a94a0916b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.264193:0:33796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff974742045200/0xcd9d312a94a0916b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.264202:0:33796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff974742045200/0xcd9d312a94a0916b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.264209:0:33796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974742045200/0xcd9d312a94a0916b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938812.267274:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784938812.267293:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1784938812.275718:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:12803:x1871643342567296:12345-0@lo:253:kworker.0 Request processed in 262234us (268462us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938812.275744:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:2.0:1784938812.275896:0:12803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784938812.275900:0:12803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784938812.275901:0:12803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938812.275903:0:12803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938812.275905:0:12803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938812.275906:0:12803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938812.275908:0:12803:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938812.275910:0:12803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938812.275912:0:12803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784938812.275916:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342567296:0@lo:253:kworker.0 00000100:00100000:2.0:1784938812.279155:0:33790:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784938812.279178:0:33790:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1784938812.280303:0:33790:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1784938812.280333:0:33790:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1784938812.280343:0:33790:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1784938812.281518:0:33790:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784938812.281571:0:33790:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1784938812.281576:0:33790:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784938812.281579:0:33790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784938812.281580:0:33790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938812.281581:0:33790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938812.281582:0:33790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938812.281588:0:33790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938812.281589:0:33790:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938812.281591:0:33790:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784938812.281593:0:33790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938812.281594:0:33790:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784938812.281597:0:33790:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1784938812.281599:0:33790:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784938812.281600:0:33790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784938812.281600:0:33790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938812.281601:0:33790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938812.281602:0:33790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938812.281609:0:33790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938812.281611:0:33790:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938812.281612:0:33790:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784938812.281613:0:33790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938812.281614:0:33790:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784938812.281652:0:33790:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784938812.281680:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342567552:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784938812.281806:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938812.283167:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342567552 00000100:00100000:2.0:1784938812.283181:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342567552 00000100:00100000:2.0:1784938812.283239:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784938812.283251:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97471da21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:33790:x1871643342567552:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784938812.283332:0:33795:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784938812.283336:0:33795:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784938812.283340:0:33795:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1784938812.283349:0:33795:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784938812.283534:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff974735bce180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938812.286208:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:12804:x1871643342567424:12345-0@lo:253:kworker.0 Request processed in 275838us (280033us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938812.286227:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:3.0:1784938812.286624:0:12804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1784938812.286628:0:12804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938812.286629:0:12804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938812.286631:0:12804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938812.286632:0:12804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938812.286634:0:12804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938812.286635:0:12804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938812.286638:0:12804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938812.286639:0:12804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1784938812.286644:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342567424:0@lo:253:kworker.0 00000100:00100000:2.0:1784938812.291490:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97471da21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+5:33790:x1871643342567552:12345-0@lo:253:mount.lustre.0 Request processed in 8224us (9668us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938812.291509:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784938812.291613:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342567552:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784938812.291633:0:33790:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784938812.291637:0:33790:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784938812.291639:0:33790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784938812.291640:0:33790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938812.291641:0:33790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938812.291642:0:33790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938812.291644:0:33790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938812.291645:0:33790:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938812.291647:0:33790:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784938812.291649:0:33790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938812.291651:0:33790:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784938812.291679:0:33790:0:(tgt_mount.c:101:server_register_mount()) register mount ffff974607ca0800 from lustre-MDT0000 10000000:01000000:1.0:1784938812.292051:0:33790:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1784938812.292056:0:33790:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784938812.292125:0:33790:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff974607ca0800 10000000:01000000:1.0:1784938812.292131:0:33790:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784938812.292137:0:33790:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff974607ca0800 10000000:01000000:1.0:1784938812.292140:0:33790:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784938812.292143:0:33790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff974607ca0800 from 1 10000000:01000000:1.0:1784938812.292146:0:33790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784938812.292197:0:33790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.292211:0:33790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.292222:0:33790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938812.292245:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342567680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938812.292288:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938812.292386:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff974735bce900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938812.292435:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342567680 00000100:00100000:3.0:1784938812.292443:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342567680 00000100:00100000:3.0:1784938812.292726:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784938812.292738:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97471da22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+5:33790:x1871643342567680:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938812.292786:0:33794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938812.292807:0:33794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974742045200/0xcd9d312a94a09179 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a09172 expref: -99 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.293048:0:33794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974742045200/0xcd9d312a94a09179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a09172 expref: 6 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.293072:0:33794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974742045200/0xcd9d312a94a09179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a09172 expref: 6 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.293083:0:33794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045200, rc 0) 00000100:00100000:2.0:1784938812.293136:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97471da22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:33790:x1871643342567680:12345-0@lo:101:mount.lustre.0 Request processed in 401us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938812.293154:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784938812.293242:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342567680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938812.293260:0:33790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.293270:0:33790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938812.293292:0:33790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784938812.293313:0:33790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.293321:0:33790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938812.293328:0:33790:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784938812.293333:0:33790:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784938812.293338:0:33790:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff974607ca0800 10000000:01000000:3.0:1784938812.293341:0:33790:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784938812.293345:0:33790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784938812.293347:0:33790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784938812.293367:0:33790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.293375:0:33790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.293383:0:33790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938812.293412:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342567808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938812.293445:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938812.293801:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bc300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938812.293911:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342567808 00000100:00100000:1.0:1784938812.293918:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342567808 00000100:00100000:1.0:1784938812.293951:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784938812.293959:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97471da21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:33790:x1871643342567808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938812.293972:0:33793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938812.293989:0:33793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460290a200/0xcd9d312a94a09187 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a09180 expref: -99 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.294240:0:33793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460290a200/0xcd9d312a94a09187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a09180 expref: 7 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.294262:0:33793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460290a200/0xcd9d312a94a09187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a09180 expref: 7 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.294270:0:33793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a200, rc 0) 00000100:00100000:1.0:1784938812.294358:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97471da21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+7:33790:x1871643342567808:12345-0@lo:101:mount.lustre.0 Request processed in 399us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938812.294365:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784938812.294492:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342567808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938812.294507:0:33790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.294516:0:33790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938812.294586:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342567936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938812.294615:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938812.294680:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bc300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938812.294720:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342567936 00000100:00100000:1.0:1784938812.294725:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342567936 00000100:00100000:1.0:1784938812.294979:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784938812.294989:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97471da23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+7:33790:x1871643342567936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938812.297592:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97471da23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:33790:x1871643342567936:12345-0@lo:501:mount.lustre.0 Request processed in 2592us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938812.297608:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784938812.298025:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342567936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938812.298174:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342568064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938812.298247:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938812.298334:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bc300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938812.298402:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342568064 00000100:00100000:1.0:1784938812.298410:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342568064 00000100:00100000:1.0:1784938812.298477:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784938812.298487:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a09bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:33790:x1871643342568064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938812.306517:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a09bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:33790:x1871643342568064:12345-0@lo:503:mount.lustre.0 Request processed in 8015us (8254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938812.306537:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784938812.307029:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342568064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938812.308241:0:33817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33817:1871643342568192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938812.308330:0:33817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938812.308383:0:33817:0:(client.c:2702:ptlrpc_set_wait()) set ffff974706b5ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938812.308449:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342568192 00000100:00100000:3.0:1784938812.308458:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342568192 00000100:00100000:3.0:1784938812.308560:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938812.308571:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:33817:x1871643342568192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938812.314273:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:33817:x1871643342568192:12345-0@lo:502:llog_process_th.0 Request processed in 5690us (5930us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938812.314322:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784938812.315706:0:33817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746047bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33817:1871643342568192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938812.316218:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938812.316237:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938812.316240:0:33817:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784938812.316260:0:33817:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784938812.316265:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938812.316284:0:33817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff974602f619c0) 00000020:00000080:1.0:1784938812.316318:0:33817:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1784938812.316327:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784938812.316430:0:33817:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784938812.316440:0:33817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a09195 00000020:00000080:1.0:1784938812.316706:0:33817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784938812.316711:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938812.316715:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938812.316717:0:33817:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784938812.316720:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938812.316724:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938812.316726:0:33817:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1784938812.316729:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938812.316738:0:33817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff974602f64d40) 00000020:00000080:1.0:1784938812.317189:0:33817:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1784938812.317200:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784938812.317204:0:33817:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1784938812.317208:0:33817:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1784938812.317215:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784938812.317277:0:33817:0:(tgt_mount.c:153:server_get_mount()) get mount ffff974607ca0800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784938812.317293:0:33817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff974602f63380) 00000020:00000080:1.0:1784938812.317303:0:33817:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1784938812.317356:0:33817:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784938812.317364:0:33817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a091aa 00000020:00000080:1.0:1784938812.317485:0:33817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1784938812.317491:0:33817:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784938812.317497:0:33817:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcd9d312a94a091b1 00080000:01000000:1.0:1784938812.317502:0:33817:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784938812.317506:0:33817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a091b8 00010000:00010000:1.0:1784938812.471166:0:33817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-3 is initialized 00000001:00000004:0.0:1784938812.484731:0:33817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967565 00000001:00080000:0.0:1784938812.485325:0:33817:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1784938812.486693:0:33817:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97473bae0000) 00000020:00000080:0.0:1784938812.486729:0:33817:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1784938812.487024:0:33817:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1784938812.487034:0:33817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a091c6 00000020:00000080:0.0:1784938812.492640:0:33817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784938812.512981:0:33817:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcd9d312a94a091cd 00000020:00000080:1.0:1784938812.513617:0:33817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784938812.513637:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938812.513643:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938812.513645:0:33817:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784938812.513647:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938812.513653:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938812.513654:0:33817:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784938812.513658:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784938812.513697:0:33817:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784938812.513707:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938812.513709:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938812.513710:0:33817:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784938812.513711:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784938812.513713:0:33817:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1784938812.513714:0:33817:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784938812.513715:0:33817:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784938812.513716:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784938812.513717:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938812.513718:0:33817:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784938812.513719:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784938812.513721:0:33817:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784938812.513723:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938812.513724:0:33817:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784938812.513726:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784938812.513731:0:33817:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:1.0:1784938812.513781:0:33817:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784938812.513785:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938812.513804:0:33817:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff974602f60000) 00000020:00000080:1.0:1784938812.513825:0:33817:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1784938812.513830:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784938812.513900:0:33817:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784938812.513907:0:33817:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784938812.513915:0:33817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a091db 00010000:00080000:1.0:1784938812.513958:0:33817:0:(ldlm_lib.c:125:import_set_conn()) imp ffff974703e98800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1784938812.514317:0:33817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1784938812.514703:0:33817:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784938812.514737:0:33817:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784938812.547697:0:33817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938812.550741:0:33817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1784938812.551590:0:33817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1784938812.552298:0:33821:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784938812.552305:0:33821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784938812.553308:0:33817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784938812.553325:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784938812.553368:0:33817:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784938812.553396:0:33817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a091e2 00000100:00080000:1.0:1784938812.553413:0:33817:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.202.104@tcp last attempt 0 00000100:00080000:1.0:1784938812.553427:0:33817:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff974703e98800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:1.0:1784938812.553475:0:33817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974603682300 x1871643342568320/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938812.553522:0:33817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1784938812.553591:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938812.553595:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938812.553598:0:33817:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784938812.553601:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784938812.553604:0:33817:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1784938812.553606:0:33817:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784938812.553608:0:33817:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784938812.553610:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784938812.553612:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938812.553614:0:33817:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784938812.553616:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784938812.553621:0:33817:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784938812.553625:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938812.553626:0:33817:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784938812.553629:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784938812.553634:0:33817:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:1.0:1784938812.553655:0:33817:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784938812.553658:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938812.553681:0:33817:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff974729eacd40) 00000020:00000080:1.0:1784938812.553698:0:33817:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1784938812.553704:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784938812.553807:0:33817:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1784938812.553815:0:33817:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784938812.553822:0:33817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a091f0 00010000:00080000:1.0:1784938812.553867:0:33817:0:(ldlm_lib.c:125:import_set_conn()) imp ffff97473a5c9800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.104@tcp at head 00000100:00100000:0.0:1784938812.554103:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342568320:192.168.202.104@tcp:8:llog_process_th.0 00000100:00100000:0.0:1784938812.554456:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938812.554488:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342568320 00000100:00100000:0.0:1784938812.554496:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342568320 00000100:00100000:0.0:1784938812.554536:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 174 00000100:00100000:0.0:1784938812.554545:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:12801:x1871643342568320:12345-192.168.202.104@tcp:8:llog_process_th.0 00010000:00080000:0.0:1784938812.554575:0:31425:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 966 last 0 00000020:00000080:0.0:1784938812.554602:0:31425:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a091f7 00002000:00100000:0.0:1784938812.554617:0:31425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff974603c33800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784938812.554629:0:31425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1784938812.554633:0:31425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1784938812.555240:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938812.555255:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342568448:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938812.555444:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00002000:00080000:0.0:1784938812.555504:0:31425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784938812.555545:0:31425:0:(import.c:65:import_set_state_nolock()) ffff974702c45800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938812.555607:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:12801:x1871643342568320:12345-192.168.202.104@tcp:8:llog_process_th.0 Request processed in 1060us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938812.555619:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 174 00000100:00100000:0.0:1784938812.555730:0:12801:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938812.555741:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784938812.555778:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784938812.555785:0:12801:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784938812.555788:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974703e98800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784938812.555798:0:12801:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784938812.555805:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342568320:192.168.202.104@tcp:8:llog_process_th.0 00000004:00080000:0.0:1784938812.555837:0:33821:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784938812.556242:0:33821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 966393489375ns, next at 0ns, rc = 0 00000100:00100000:1.0:1784938812.556391:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342568576:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938812.556548:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938812.556585:0:33800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342568448 00000100:00100000:1.0:1784938812.556590:0:33800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342568448 00000100:00100000:1.0:1784938812.556618:0:33800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342568576 00000100:00100000:1.0:1784938812.556620:0:33800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342568576 00000100:00100000:1.0:1784938812.556633:0:33800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:1.0:1784938812.556640:0:33800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12804:x1871643342568448:12345-192.168.202.104@tcp:400:kworker.0 00000020:00080000:1.0:1784938812.556648:0:33800:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.104@tcp 00000100:00100000:1.0:1784938812.556681:0:33800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12804:x1871643342568448:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 39us (1237us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784938812.556688:0:33800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:1.0:1784938812.556704:0:33800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:1.0:1784938812.556709:0:33800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12802:x1871643342568576:12345-192.168.202.104@tcp:400:kworker.0 00000020:00080000:1.0:1784938812.556713:0:33800:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.104@tcp 00000100:00100000:1.0:1784938812.556734:0:33800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12802:x1871643342568576:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 24us (187us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784938812.556740:0:33800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00080000:1.0:1784938812.556927:0:12802:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@192.168.202.104@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1784938812.556932:0:12802:0:(import.c:65:import_set_state_nolock()) ffff974729ece000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784938812.556944:0:12802:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 192.168.202.104@tcp) was lost; in progress operations using this service will wait for recovery to complete 00010000:00010000:0.0:1784938812.557593:0:33817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-4 is initialized 00000040:01000000:0.0:1784938812.557853:0:33817:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784938812.557883:0:33817:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1784938812.558733:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342568704:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00080000:2.0:1784938812.558908:0:12804:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@192.168.202.104@tcp abruptly disconnected: reconnecting 00000100:00080000:2.0:1784938812.558915:0:12804:0:(import.c:65:import_set_state_nolock()) ffff974718b1c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784938812.558919:0:12804:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 192.168.202.104@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784938812.558925:0:12804:0:(import.c:65:import_set_state_nolock()) ffff974718b1c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938812.558930:0:12804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.202.104@tcp last attempt 893 00000100:00080000:2.0:1784938812.558941:0:12804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff974718b1c800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:2.0:1784938812.558967:0:12804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97460b0fe680 x1871643342568832/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938812.558990:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342568448:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938812.559033:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342568832:192.168.202.104@tcp:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784938812.561382:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938812.561418:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938812.561456:0:31430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342568704 00000100:00100000:0.0:1784938812.561466:0:31430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342568704 00000100:00080000:2.0:1784938812.562190:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938812.562417:0:31430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 23 00000100:00100000:0.0:1784938812.562432:0:31430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:12803:x1871643342568704:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938812.562605:0:31430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 386924544 avail 384827392 00000100:00100000:0.0:1784938812.562728:0:31430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:12803:x1871643342568704:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 300us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938812.562744:0:31430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 23 00000100:00100000:0.0:1784938812.562818:0:33800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342568832 00000100:00100000:0.0:1784938812.562824:0:33800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342568832 00000100:00100000:0.0:1784938812.562850:0:33800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:0.0:1784938812.562855:0:33800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12801:x1871643342568832:12345-192.168.202.104@tcp:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784938812.562912:0:33800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12801:x1871643342568832:12345-192.168.202.104@tcp:38:ptlrpcd_00_02.0 Request processed in 54us (1493us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784938812.562920:0:33800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:2.0:1784938812.576820:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342568704:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00080000:2.0:1784938812.576904:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974718b1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938812.576911:0:12801:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.104@tcp failed (-11) 00000100:00100000:2.0:1784938812.576915:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342568832:192.168.202.104@tcp:38:ptlrpcd_00_02.0 00000040:00080000:0.0:1784938812.580561:0:33817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938812.585522:0:33817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1784938812.585703:0:33817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1784938812.586511:0:33823:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784938812.586517:0:33823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784938812.590449:0:33817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938812.590470:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784938812.590687:0:33817:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784938812.590718:0:33817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a091fe 00000100:00080000:3.0:1784938812.590737:0:33817:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.202.104@tcp last attempt 0 00000100:00080000:3.0:1784938812.590834:0:33817:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97473a5c9800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:3.0:1784938812.590939:0:33817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974602fb4a80 x1871643342568960/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938812.591024:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342568960:192.168.202.104@tcp:8:llog_process_th.0 00000100:00100000:0.0:1784938812.591439:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938812.591482:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342568960 00000100:00100000:0.0:1784938812.591508:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342568960 00000100:00100000:0.0:1784938812.591550:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 175 00000100:00100000:0.0:1784938812.591559:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:12801:x1871643342568960:12345-192.168.202.104@tcp:8:llog_process_th.0 00010000:00080000:0.0:1784938812.591591:0:31427:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 966 last 0 00000020:00000080:0.0:1784938812.591623:0:31427:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a09205 00002000:00100000:0.0:1784938812.591637:0:31427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9747102a9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784938812.591642:0:31427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784938812.591646:0:31427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784938812.591966:0:31427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784938812.592013:0:31427:0:(import.c:65:import_set_state_nolock()) ffff9747102ad000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938812.592075:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:12801:x1871643342568960:12345-192.168.202.104@tcp:8:llog_process_th.0 Request processed in 515us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938812.592094:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 175 00000100:00080000:3.0:1784938812.592698:0:33817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1784938812.595320:0:12802:0:(import.c:65:import_set_state_nolock()) ffff974729ece000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938812.595338:0:12802:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.202.104@tcp last attempt 911 00000100:00080000:1.0:1784938812.595357:0:12802:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff974729ece000 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000020:01000000:3.0:1784938812.595427:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938812.595439:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938812.595441:0:33817:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784938812.595445:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938812.595451:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938812.595452:0:33817:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784938812.595455:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784938812.595457:0:33817:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784938812.596881:0:12802:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974603681c00 x1871643342569088/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938812.596911:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342568576:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938812.597176:0:33817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33817:1871643342569216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938812.599526:0:33817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938812.599584:0:33817:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938812.600689:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342569216 00000100:00100000:1.0:1784938812.600707:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342569216 00000100:00100000:3.0:1784938812.600955:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784938812.600976:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:33817:x1871643342569216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938812.601189:0:12801:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784938812.601204:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784938812.601215:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784938812.601222:0:12801:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784938812.601228:0:12801:0:(import.c:65:import_set_state_nolock()) ffff97473a5c9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784938812.601416:0:12801:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784938812.601428:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342568960:192.168.202.104@tcp:8:llog_process_th.0 00000100:00100000:2.0:1784938812.601467:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342569088:192.168.202.104@tcp:38:ptlrpcd_00_00.0 00000004:00080000:2.0:1784938812.601594:0:33823:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1784938812.602603:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:33817:x1871643342569216:12345-0@lo:502:llog_process_th.0 Request processed in 1630us (3082us total) trans 0 rc 0/0 00000004:00080000:2.0:1784938812.603140:0:33823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 966438997418ns, next at 0ns, rc = 0 00000100:00100000:2.0:1784938812.603373:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938812.603445:0:33798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342569088 00000100:00100000:2.0:1784938812.603456:0:33798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342569088 00000100:00100000:2.0:1784938812.603502:0:33798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00100000:2.0:1784938812.603510:0:33798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:12801:x1871643342569088:12345-192.168.202.104@tcp:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784938812.603580:0:33798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:12801:x1871643342569088:12345-192.168.202.104@tcp:38:ptlrpcd_00_00.0 Request processed in 69us (209us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784938812.603587:0:33798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00080000:2.0:1784938812.603717:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974729ece000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938812.603724:0:12801:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.104@tcp failed (-11) 00000100:00100000:2.0:1784938812.603728:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342569088:192.168.202.104@tcp:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784938812.605176:0:33817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33817:1871643342569216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938812.605235:0:33817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938812.605245:0:33817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938812.605263:0:33817:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784938812.605269:0:33817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1784938812.605782:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342569344:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938812.606086:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938812.606121:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342569344 00000100:00100000:0.0:1784938812.606129:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342569344 00000100:00100000:0.0:1784938812.606187:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 24 00000100:00100000:0.0:1784938812.606196:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:12804:x1871643342569344:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938812.606237:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 384827392 avail 382730240 00000100:00100000:0.0:1784938812.606280:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:12804:x1871643342569344:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 84us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938812.606288:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 24 00000100:00080000:0.0:1784938812.606311:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938812.607521:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342569344:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938812.607777:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:3.0:1784938812.607860:0:33790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-33 (rc=0) 10000000:01000000:3.0:1784938812.607920:0:33790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784938812.607943:0:33790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.607956:0:33790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938812.607965:0:33790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff974607ca0800 from 1 10000000:01000000:3.0:1784938812.607968:0:33790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784938812.608022:0:33790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.608032:0:33790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.608044:0:33790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938812.608224:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342569472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938812.608281:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938812.608327:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bc480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938812.608397:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342569472 00000100:00100000:2.0:1784938812.608405:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342569472 00000100:00100000:2.0:1784938812.608457:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784938812.608467:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a09ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:33790:x1871643342569472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938812.608483:0:33794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938812.608502:0:33794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609c47600/0xcd9d312a94a09213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a0920c expref: -99 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.608540:0:33794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609c47600/0xcd9d312a94a09213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a0920c expref: 9 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.608553:0:33794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609c47600/0xcd9d312a94a09213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a0920c expref: 9 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.608563:0:33794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609c47600, rc 0) 00000100:00100000:2.0:1784938812.608599:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a09ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:33790:x1871643342569472:12345-0@lo:101:mount.lustre.0 Request processed in 133us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938812.608606:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784938812.610948:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342569472:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938812.610983:0:33790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09213 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.611008:0:33790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09213 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938812.612257:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342569600:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1784938812.612361:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938812.612413:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bc480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938812.612448:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342569600 00000100:00100000:3.0:1784938812.612456:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342569600 00000100:00100000:3.0:1784938812.612515:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784938812.612524:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:33790:x1871643342569600:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784938812.612551:0:33795:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784938812.612572:0:33795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784938812.612577:0:33795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784938812.612579:0:33795:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 7 00000100:00100000:3.0:1784938812.612676:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:33790:x1871643342569600:12345-0@lo:256:mount.lustre.0 Request processed in 152us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938812.612683:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784938812.612740:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342569600:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1784938812.620818:0:33790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784938812.620851:0:33790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09213 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.620869:0:33790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09213 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938812.620881:0:33790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff974607ca0800 from 1 10000000:01000000:3.0:1784938812.620885:0:33790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938812.622226:0:33790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.622241:0:33790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.622276:0:33790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938812.622310:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342569728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938812.622402:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938812.622463:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bc480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938812.625358:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342569728 00000100:00100000:3.0:1784938812.625380:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342569728 00000100:00100000:3.0:1784938812.625458:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938812.625471:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472ffc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:33790:x1871643342569728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938812.628445:0:33794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938812.628485:0:33794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974742045e00/0xcd9d312a94a09221 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a0921a expref: -99 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.628543:0:33794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974742045e00/0xcd9d312a94a09221 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a0921a expref: 10 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.628558:0:33794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974742045e00/0xcd9d312a94a09221 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a0921a expref: 10 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.628571:0:33794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045e00, rc 0) 00000100:00100000:3.0:1784938812.628679:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472ffc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:33790:x1871643342569728:12345-0@lo:101:mount.lustre.0 Request processed in 3210us (6275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938812.628690:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938812.628796:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342569728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938812.628820:0:33790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.628843:0:33790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938812.633548:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342569856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938812.633645:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938812.633700:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bc480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938812.633731:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342569856 00000100:00100000:3.0:1784938812.633739:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342569856 00000100:00100000:3.0:1784938812.633813:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784938812.633822:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472ffc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:33790:x1871643342569856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938812.635015:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472ffc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:33790:x1871643342569856:12345-0@lo:501:mount.lustre.0 Request processed in 1187us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938812.635027:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784938812.635174:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342569856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938812.635240:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342569984:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938812.635292:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938812.635322:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe61840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938812.635342:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342569984 00000100:00100000:2.0:1784938812.635349:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342569984 00000100:00100000:2.0:1784938812.635389:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784938812.635398:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472ffc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:33790:x1871643342569984:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938812.635852:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472ffc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:33790:x1871643342569984:12345-0@lo:503:mount.lustre.0 Request processed in 453us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938812.635860:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784938812.635906:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342569984:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938812.640439:0:33825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33825:1871643342570112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938812.640579:0:33825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938812.640639:0:33825:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe61b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938812.640712:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342570112 00000100:00100000:3.0:1784938812.640722:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342570112 00000100:00100000:3.0:1784938812.640813:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784938812.640823:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472ffc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:33825:x1871643342570112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938812.641921:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472ffc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:33825:x1871643342570112:12345-0@lo:502:llog_process_th.0 Request processed in 1094us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938812.641933:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784938812.642027:0:33825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33825:1871643342570112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938812.642844:0:33825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938812.642858:0:33825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938812.642861:0:33825:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784938812.642870:0:33825:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff974607ca0800 00000020:00000080:3.0:1784938812.642884:0:33825:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938812.642896:0:33825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938812.642899:0:33825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938812.642900:0:33825:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784938812.642903:0:33825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938812.642906:0:33825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938812.642907:0:33825:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784938812.642910:0:33825:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff974607ca0800 00000020:00000080:3.0:1784938812.642911:0:33825:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784938812.643040:0:33825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33825:1871643342570240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938812.646089:0:33825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938812.646156:0:33825:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bc480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938812.651950:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342570240 00000100:00100000:1.0:1784938812.651974:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342570240 00000100:00100000:1.0:1784938812.652384:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784938812.652398:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472ffc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:33825:x1871643342570240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938812.653259:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472ffc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:33825:x1871643342570240:12345-0@lo:502:llog_process_th.0 Request processed in 861us (7177us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938812.653270:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784938812.653713:0:33825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33825:1871643342570240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938812.653789:0:33825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938812.653798:0:33825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938812.653801:0:33825:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784938812.653806:0:33825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784938812.653973:0:33790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1784938812.654007:0:33790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938812.654025:0:33790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.654037:0:33790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938812.654104:0:33790:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784938812.654108:0:33790:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff974607ca0800 10000000:01000000:3.0:1784938812.654113:0:33790:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff974607ca0800 10000000:01000000:3.0:1784938812.654118:0:33790:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784938812.654125:0:33790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff974607ca0800 from 1 10000000:01000000:3.0:1784938812.654138:0:33790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784938812.654181:0:33790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.654191:0:33790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.654201:0:33790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938812.654225:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342570368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938812.654274:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938812.654310:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938812.657286:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342570368 00000100:00100000:2.0:1784938812.657308:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342570368 00000100:00100000:2.0:1784938812.657377:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784938812.657389:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97472ffc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:33790:x1871643342570368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938812.657415:0:33795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938812.657442:0:33795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609c46600/0xcd9d312a94a0922f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a09228 expref: -99 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.657477:0:33795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609c46600/0xcd9d312a94a0922f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a09228 expref: 11 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.657491:0:33795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609c46600/0xcd9d312a94a0922f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a09228 expref: 11 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.657501:0:33795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609c46600, rc 0) 00000100:00100000:2.0:1784938812.657601:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97472ffc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:33790:x1871643342570368:12345-0@lo:101:mount.lustre.0 Request processed in 214us (3327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938812.657608:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1784938812.658294:0:33806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1784938812.661600:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342570368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938812.661639:0:33790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938812.661656:0:33790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938812.662886:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342570496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938812.662981:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938812.663045:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938812.672806:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342570496 00000100:00100000:1.0:1784938812.672840:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342570496 00000100:00100000:1.0:1784938812.672913:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784938812.672925:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735e04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:33790:x1871643342570496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938812.674197:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735e04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:33790:x1871643342570496:12345-0@lo:501:mount.lustre.0 Request processed in 1267us (11210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938812.674209:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784938812.679294:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342570496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938812.679399:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342570624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938812.679509:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938812.679565:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746022bcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938812.680108:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342570624 00000100:00100000:1.0:1784938812.680124:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342570624 00000100:00100000:1.0:1784938812.680182:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784938812.680191:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735e06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:33790:x1871643342570624:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938812.680627:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735e06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:33790:x1871643342570624:12345-0@lo:503:mount.lustre.0 Request processed in 435us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938812.680637:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784938812.680713:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342570624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938812.682498:0:33828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33828:1871643342570752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938812.682600:0:33828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938812.682657:0:33828:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a54840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938812.682839:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342570752 00000100:00100000:2.0:1784938812.682849:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342570752 00000100:00100000:2.0:1784938812.682906:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784938812.682916:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735e06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:33828:x1871643342570752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938812.683417:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735e06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:33828:x1871643342570752:12345-0@lo:502:llog_process_th.0 Request processed in 500us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938812.683428:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784938812.683505:0:33828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33828:1871643342570752:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1784938812.683583:0:33828:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784938812.683603:0:33828:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff974707f2b380) 00000020:00000080:2.0:1784938812.683633:0:33828:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1784938812.686960:0:33828:0:(tgt_mount.c:153:server_get_mount()) get mount ffff974607ca0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784938812.686984:0:33828:0:(tgt_mount.c:187:server_put_mount()) put mount ffff974607ca0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784938812.686988:0:33828:0:(obd_mount.c:706:lustre_put_lsi()) put ffff974607ca0800 4 00010000:00080000:3.0:1784938812.687066:0:33828:0:(ldlm_lib.c:125:import_set_conn()) imp ffff974703e9d000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:3.0:1784938812.689047:0:33828:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-5 is initialized 00000020:00000080:3.0:1784938812.689193:0:33828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784938812.689281:0:33828:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784938812.689300:0:33828:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcd9d312a94a0923d 00000100:00080000:3.0:1784938812.689318:0:33828:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 192.168.202.104@tcp last attempt 0 00000100:00080000:3.0:1784938812.689331:0:33828:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff974703e9d000 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:3.0:1784938812.689380:0:33828:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974602fb5500 x1871643342570880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938812.689433:0:33828:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784938812.690656:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342570880:192.168.202.104@tcp:38:llog_process_th.0 00000100:00100000:0.0:1784938812.691368:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938812.691440:0:33801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342570880 00000100:00100000:0.0:1784938812.691450:0:33801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342570880 00000100:00100000:0.0:1784938812.691502:0:33801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00100000:0.0:1784938812.691511:0:33801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:12801:x1871643342570880:12345-192.168.202.104@tcp:38:llog_process_th.0 00000100:00100000:0.0:1784938812.691587:0:33801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:12801:x1871643342570880:12345-192.168.202.104@tcp:38:llog_process_th.0 Request processed in 74us (221us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784938812.691596:0:33801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00100000:0.0:1784938812.691743:0:12801:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938812.691776:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974703e9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784938812.691783:0:12801:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.104@tcp failed (-11) 00000100:00100000:0.0:1784938812.691787:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342570880:192.168.202.104@tcp:38:llog_process_th.0 00000100:00100000:0.0:1784938812.691964:0:33828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33828:1871643342571008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938812.692038:0:33828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938812.692069:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342571008 00000100:00100000:0.0:1784938812.692073:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342571008 00000100:00100000:0.0:1784938812.692108:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784938812.692115:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:33828:x1871643342571008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938812.692407:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735e07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:33828:x1871643342571008:12345-0@lo:502:llog_process_th.0 Request processed in 291us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938812.692415:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784938812.692573:0:33828:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938812.692589:0:33828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:33828:1871643342571008:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784938812.692614:0:33828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1784938812.692944:0:33790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1784938812.692969:0:33790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784938812.693007:0:33790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.693020:0:33790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784938812.693086:0:33790:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784938812.693089:0:33790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784938812.693091:0:33790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938812.693092:0:33790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938812.693093:0:33790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938812.693094:0:33790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938812.693096:0:33790:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938812.693097:0:33790:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784938812.693100:0:33790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938812.693101:0:33790:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784938812.693106:0:33790:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1784938812.693108:0:33790:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784938812.693109:0:33790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784938812.693110:0:33790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938812.693111:0:33790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938812.693117:0:33790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938812.693118:0:33790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938812.693119:0:33790:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938812.693120:0:33790:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784938812.693120:0:33790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938812.693121:0:33790:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784938812.693141:0:33790:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784938812.693156:0:33790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342571136:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784938812.693196:0:33790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938812.693234:0:33790:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938812.694332:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342571136 00000100:00100000:0.0:1784938812.694344:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342571136 00000100:00100000:0.0:1784938812.694395:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784938812.694404:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735e06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:33790:x1871643342571136:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784938812.694441:0:33793:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784938812.694460:0:33793:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1784938812.727016:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784938812.740699:0:33806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 20000000:01000000:0.0:1784938812.838009:0:33793:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784938812.838035:0:33793:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784938812.839165:0:33796:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784938812.839176:0:33796:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784938812.839211:0:33796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.839235:0:33796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974609c47600/0xcd9d312a94a09213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a0920c expref: 11 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.839245:0:33796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.839300:0:33796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974609c47600/0xcd9d312a94a09213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a0920c expref: 11 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.839434:0:33796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974609c47600/0xcd9d312a94a09213 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a0920c expref: 11 pid: 33794 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938812.839454:0:33796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0ffb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:33796:1871643342571264:0@lo:104: 00000100:00100000:2.0:1784938812.839542:0:33796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938812.839683:0:33796:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe619c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938812.848617:0:30613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342571264 00000100:00100000:1.0:1784938812.848640:0:30613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342571264 00000100:00100000:1.0:1784938812.848709:0:30613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784938812.848721:0:30613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:33796:x1871643342571264:12345-0@lo:104: 00010000:00010000:1.0:1784938812.848746:0:30613:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a09213 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.848898:0:30613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784938812.848905:0:30613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:33796:x1871643342571264:12345-0@lo:104: Request processed in 187us (9364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938812.848913:0:30613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784938812.848979:0:33796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0ffb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:33796:1871643342571264:0@lo:104: 00010000:00010000:1.0:1784938812.849024:0:33796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.849046:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938812.849053:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a09213 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.849061:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045c00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:1.0:1784938812.849085:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a09213 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.849095:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a09213 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938812.849104:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a09213 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938812.849111:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938812.849159:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a09213 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.849166:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938812.849196:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a09213 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.849203:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974742045c00/0xcd9d312a94a0920c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a09213 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.849224:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938812.849227:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938812.849228:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938812.849254:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342571392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938812.850377:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938812.850552:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342571392 00000100:00100000:2.0:1784938812.850561:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342571392 00010000:00010000:2.0:1784938812.850593:0:30616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974609c47600/0xcd9d312a94a09213 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a0920c expref: 12 pid: 33794 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938812.850633:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784938812.850642:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:12805:x1871643342571392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938812.850657:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938812.850664:0:30616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974609c47600/0xcd9d312a94a09213 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a0920c expref: 12 pid: 33794 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.850677:0:30616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974609c47600/0xcd9d312a94a09213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a0920c expref: 12 pid: 33794 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.850696:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609c47600/0xcd9d312a94a09213 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a0920c expref: 12 pid: 33794 timeout: 1066 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.850713:0:30616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.850723:0:30616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784938812.850740:0:30616:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011566369s 00010000:00010000:2.0:1784938812.850745:0:30616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.850781:0:30616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.850788:0:30616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.850809:0:30616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.850816:0:30616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938812.850822:0:30616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.850831:0:30616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.850845:0:30616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938812.850856:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938812.850902:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:12805:x1871643342571392:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938812.850909:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:1.0:1784938812.850982:0:33796:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.850991:0:33796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938812.851020:0:33796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609c47000/0xcd9d312a94a09244 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938812.851061:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342571392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938812.894644:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735e06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:33790:x1871643342571136:12345-0@lo:253:mount.lustre.0 Request processed in 200226us (201432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938812.894684:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784938812.899508:0:33790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603680000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:33790:1871643342571136:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784938812.899535:0:33790:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784938812.899539:0:33790:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784938812.899541:0:33790:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784938812.899542:0:33790:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938812.899544:0:33790:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938812.899546:0:33790:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938812.899548:0:33790:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938812.899549:0:33790:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938812.899551:0:33790:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784938812.899553:0:33790:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938812.899555:0:33790:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784938812.899581:0:33790:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784938812.919275:0:33790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938812.923086:0:33790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784938812.924254:0:33790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938812.924447:0:33790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784938812.924725:0:33790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938812.927823:0:33790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1784938812.950184:0:33790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1784938812.951165:0:33790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1784938812.951905:0:33790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1784938812.952237:0:33790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1784938812.952622:0:33790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1784938812.955836:0:33790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:3.0:1784938813.041873:0:33790:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1784938813.044567:0:33834:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1784938813.046511:0:33834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1784938813.048542:0:33833:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1784938813.048552:0:33833:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1784938813.060416:0:33834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784938813.060553:0:33834:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784938813.060559:0:33834:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1784938813.079912:0:33790:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1784938813.080231:0:33790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1784938813.081984:0:33790:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784938813.082022:0:33790:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784938813.082702:0:33790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938813.094664:0:33790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784938813.097956:0:33790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784938813.098047:0:33790:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1784938813.098444:0:33790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1784938813.099428:0:33790:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1784938813.145229:0:33790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1784938813.383200:0:33790:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784938813.383259:0:33790:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa2eec1543988 00100000:10000000:3.0:1784938813.383271:0:33790:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1784938813.385698:0:33790:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784938813.385791:0:33790:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784938813.385813:0:33790:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1784938813.385854:0:33790:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000004:00080000:1.0:1784938813.386050:0:33824:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x28:0x0] 00000100:00100000:1.0:1784938813.386119:0:33824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603680000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:33824:1871643342571520:192.168.202.104@tcp:5:osp-pre-1-0.0 00000004:00080000:0.0:1784938813.386496:0:33822:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x29:0x0] 00000100:00100000:0.0:1784938813.386526:0:33822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:33822:1871643342571648:192.168.202.104@tcp:5:osp-pre-0-0.0 00000100:00100000:1.0:1784938813.386841:0:33824:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938813.390528:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938813.390738:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938813.390801:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342571520 00000100:00100000:0.0:1784938813.390813:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342571520 00000100:00100000:0.0:1784938813.390879:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342571648 00000100:00100000:0.0:1784938813.390883:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342571648 00000100:00100000:0.0:1784938813.390912:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 176 00000100:00100000:0.0:1784938813.390923:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:33824:x1871643342571520:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 00002000:00080000:0.0:1784938813.401120:0:31425:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -25 00002000:02000040:0.0:1784938813.401132:0:31425:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:41 to 0x280000400:65) 00000100:00100000:1.0:1784938813.421785:0:33822:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704a54c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938813.424692:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 177 00000100:00100000:0.0:1784938813.424721:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:33822:x1871643342571648:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 00002000:00080000:0.0:1784938813.424833:0:31428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -24 00002000:02000040:0.0:1784938813.424839:0:31428:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:42 to 0x240000400:65) 00002000:00010000:2.0:1784938813.430288:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.430309:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088e90d07/0xcd9d312a94a0924b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.430332:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.430338:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.430368:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088e90d07/0xcd9d312a94a0924b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.430390:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088e90d07/0xcd9d312a94a0924b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.430404:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088e90d07/0xcd9d312a94a0924b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.430413:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088e90d07/0xcd9d312a94a0924b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.430435:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784938813.430879:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784938813.430890:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff974607ca0800 from 8 10000000:01000000:1.0:1784938813.430895:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938813.431556:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.431570:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.431583:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938813.431618:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342571776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.431708:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938813.431893:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938813.431925:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342571776 00000100:00100000:1.0:1784938813.431934:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342571776 00000100:00100000:1.0:1784938813.432076:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784938813.432086:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735e05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:30627:x1871643342571776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938813.432106:0:33795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938813.432124:0:33795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460290aa00/0xcd9d312a94a09259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a09252 expref: -99 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.432151:0:33795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460290aa00/0xcd9d312a94a09259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a09252 expref: 11 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.432163:0:33795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460290aa00/0xcd9d312a94a09259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a09252 expref: 11 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.432172:0:33795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290aa00, rc 0) 00000100:00100000:1.0:1784938813.432218:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735e05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30627:x1871643342571776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938813.432232:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784938813.432296:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342571776:0@lo:101:ll_cfg_requeue.0 00002000:00010000:2.0:1784938813.432480:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.433437:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d8f746d/0xcd9d312a94a09260 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.433462:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.433467:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.433474:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d8f746d/0xcd9d312a94a09260 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.433492:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d8f746d/0xcd9d312a94a09260 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.433502:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d8f746d/0xcd9d312a94a09260 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.433526:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d8f746d/0xcd9d312a94a09260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.433554:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784938813.434509:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.434526:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938813.434626:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342571904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.434713:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784938813.435268:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938813.435280:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088e90d07/0xcd9d312a94a0924b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938813.435288:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.435296:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b56b893/0xcd9d312a94a09267 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.435299:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.435303:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088e90d07/0xcd9d312a94a0924b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.435313:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088e90d07/0xcd9d312a94a0924b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.435318:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.435322:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.435328:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b56b893/0xcd9d312a94a09267 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.435335:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088e90d07/0xcd9d312a94a0924b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.435339:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b56b893/0xcd9d312a94a09267 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.435343:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088e90d07/0xcd9d312a94a0924b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.435348:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b56b893/0xcd9d312a94a09267 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.435356:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b56b893/0xcd9d312a94a09267 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.435360:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938813.435363:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d8f746d/0xcd9d312a94a09260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.435369:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.435372:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d8f746d/0xcd9d312a94a09260 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.435377:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938813.435718:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.435725:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674f1822/0xcd9d312a94a0926e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.435740:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.435743:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.435747:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000674f1822/0xcd9d312a94a0926e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.436608:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000674f1822/0xcd9d312a94a0926e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.436619:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674f1822/0xcd9d312a94a0926e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.436627:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000674f1822/0xcd9d312a94a0926e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.436667:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1784938813.437645:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318240 going to sleep for 11 seconds 00010000:00010000:1.0:1784938813.437673:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938813.437681:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b56b893/0xcd9d312a94a09267 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.437693:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938813.437698:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b56b893/0xcd9d312a94a09267 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.437709:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b56b893/0xcd9d312a94a09267 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.438495:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b56b893/0xcd9d312a94a09267 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.438510:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b56b893/0xcd9d312a94a09267 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.438570:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938813.438574:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000674f1822/0xcd9d312a94a0926e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.438580:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938813.438583:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000674f1822/0xcd9d312a94a0926e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.438592:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000674f1822/0xcd9d312a94a0926e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.438603:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000674f1822/0xcd9d312a94a0926e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.438611:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000674f1822/0xcd9d312a94a0926e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.438625:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938813.438627:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938813.438629:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938813.438639:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938813.439645:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d8f746d/0xcd9d312a94a09260 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.439670:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d8f746d/0xcd9d312a94a09260 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.439691:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d8f746d/0xcd9d312a94a09260 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.439715:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938813.439717:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938813.439719:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938813.444425:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.444448:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082b668bc/0xcd9d312a94a09275 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.444474:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.444481:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.444489:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082b668bc/0xcd9d312a94a09275 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.444508:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082b668bc/0xcd9d312a94a09275 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.444544:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082b668bc/0xcd9d312a94a09275 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.444553:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082b668bc/0xcd9d312a94a09275 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.444596:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938813.445535:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.445545:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ba0b27/0xcd9d312a94a0927c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.445557:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.445561:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.445566:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089ba0b27/0xcd9d312a94a0927c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.445577:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089ba0b27/0xcd9d312a94a0927c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.445581:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.445586:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ba0b27/0xcd9d312a94a0927c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.445591:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082b668bc/0xcd9d312a94a09275 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.445594:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089ba0b27/0xcd9d312a94a0927c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.445601:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938813.445611:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082b668bc/0xcd9d312a94a09275 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.445621:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082b668bc/0xcd9d312a94a09275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.445625:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938813.445642:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082b668bc/0xcd9d312a94a09275 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.445650:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082b668bc/0xcd9d312a94a09275 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.445672:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938813.445676:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089ba0b27/0xcd9d312a94a0927c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.445682:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938813.445685:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ba0b27/0xcd9d312a94a0927c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.445692:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ba0b27/0xcd9d312a94a0927c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.445700:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089ba0b27/0xcd9d312a94a0927c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.445707:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089ba0b27/0xcd9d312a94a0927c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938813.446564:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.446572:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee145be9/0xcd9d312a94a09283 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.446585:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.446589:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.446594:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee145be9/0xcd9d312a94a09283 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.446605:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee145be9/0xcd9d312a94a09283 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.446613:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee145be9/0xcd9d312a94a09283 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.446620:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee145be9/0xcd9d312a94a09283 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.446636:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938813.447420:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.447428:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001606de73/0xcd9d312a94a0928a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.447440:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.447450:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.447456:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001606de73/0xcd9d312a94a0928a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.447466:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001606de73/0xcd9d312a94a0928a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.447475:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001606de73/0xcd9d312a94a0928a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.447482:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001606de73/0xcd9d312a94a0928a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.447490:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938813.447490:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938813.447497:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee145be9/0xcd9d312a94a09283 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.447506:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938813.447511:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee145be9/0xcd9d312a94a09283 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.447521:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee145be9/0xcd9d312a94a09283 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.447539:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee145be9/0xcd9d312a94a09283 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.447546:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee145be9/0xcd9d312a94a09283 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.447561:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938813.447563:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001606de73/0xcd9d312a94a0928a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.447568:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938813.447571:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001606de73/0xcd9d312a94a0928a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.447594:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001606de73/0xcd9d312a94a0928a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.447605:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001606de73/0xcd9d312a94a0928a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.447612:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001606de73/0xcd9d312a94a0928a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.447626:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938813.447628:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938813.447631:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938813.447639:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938813.448536:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.448547:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be1d62cd/0xcd9d312a94a09291 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.448561:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.448565:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.448571:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be1d62cd/0xcd9d312a94a09291 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.448583:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be1d62cd/0xcd9d312a94a09291 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.448592:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be1d62cd/0xcd9d312a94a09291 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.448612:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be1d62cd/0xcd9d312a94a09291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.448645:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938813.449456:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.449463:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e28a11/0xcd9d312a94a09298 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.449475:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.449479:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.449484:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e28a11/0xcd9d312a94a09298 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.449494:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2e28a11/0xcd9d312a94a09298 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.449504:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e28a11/0xcd9d312a94a09298 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.449512:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e28a11/0xcd9d312a94a09298 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.449534:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938813.450151:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938813.450162:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be1d62cd/0xcd9d312a94a09291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450171:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.450177:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be1d62cd/0xcd9d312a94a09291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450187:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be1d62cd/0xcd9d312a94a09291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450209:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be1d62cd/0xcd9d312a94a09291 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450217:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be1d62cd/0xcd9d312a94a09291 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450240:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938813.450243:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2e28a11/0xcd9d312a94a09298 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450257:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.450260:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e28a11/0xcd9d312a94a09298 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450268:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e28a11/0xcd9d312a94a09298 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450279:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2e28a11/0xcd9d312a94a09298 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450285:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e28a11/0xcd9d312a94a09298 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450299:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938813.450301:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938813.450303:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938813.450439:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.450445:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bdd6afa/0xcd9d312a94a0929f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.450465:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.450468:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.450474:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bdd6afa/0xcd9d312a94a0929f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.450484:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bdd6afa/0xcd9d312a94a0929f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.450492:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bdd6afa/0xcd9d312a94a0929f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.450499:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bdd6afa/0xcd9d312a94a0929f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.450522:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938813.450676:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938813.450682:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bdd6afa/0xcd9d312a94a0929f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450690:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.450693:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bdd6afa/0xcd9d312a94a0929f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450701:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bdd6afa/0xcd9d312a94a0929f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450718:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bdd6afa/0xcd9d312a94a0929f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450726:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bdd6afa/0xcd9d312a94a0929f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.450742:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938813.450744:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938813.450746:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938813.450887:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.450894:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068758d18/0xcd9d312a94a092a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.450902:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.450906:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.450909:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068758d18/0xcd9d312a94a092a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.450919:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068758d18/0xcd9d312a94a092a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.450949:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068758d18/0xcd9d312a94a092a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.450957:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068758d18/0xcd9d312a94a092a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.450973:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938813.450981:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.450985:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068758d18/0xcd9d312a94a092a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.451009:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938813.451205:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938813.451213:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.455206:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068758d18/0xcd9d312a94a092a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.455243:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068758d18/0xcd9d312a94a092a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.455275:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068758d18/0xcd9d312a94a092a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.455285:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068758d18/0xcd9d312a94a092a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938813.455686:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342571904 00000100:00100000:3.0:1784938813.455700:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342571904 00010000:00010000:2.0:1784938813.456267:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.456283:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.456286:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938813.456516:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784938813.456529:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735e05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30627:x1871643342571904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784938813.456563:0:33793:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784938813.456582:0:33793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784938813.456586:0:33793:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00002000:00010000:2.0:1784938813.456910:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.456918:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4330898/0xcd9d312a94a092ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.456947:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.456952:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.456960:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4330898/0xcd9d312a94a092ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.456974:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4330898/0xcd9d312a94a092ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.456984:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4330898/0xcd9d312a94a092ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.457002:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4330898/0xcd9d312a94a092ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938813.458549:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735e05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30627:x1871643342571904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2011us (23824us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938813.458565:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784938813.459122:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342571904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784938813.459208:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784938813.459220:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.459230:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938813.459244:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784938813.459247:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff974724c7c800 from 39 10000000:01000000:1.0:1784938813.459250:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784938813.459373:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938813.460610:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a092b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.460628:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a092b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.460641:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a092b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938813.460674:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342572032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.460776:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938813.460829:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318240 going to sleep for 11 seconds 00010000:00010000:1.0:1784938813.460855:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938813.460864:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4330898/0xcd9d312a94a092ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.460875:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c46a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938813.460880:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4330898/0xcd9d312a94a092ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.460892:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4330898/0xcd9d312a94a092ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.460917:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4330898/0xcd9d312a94a092ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.460925:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4330898/0xcd9d312a94a092ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.460974:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938813.460976:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938813.460978:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938813.461005:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342572032 00000100:00100000:1.0:1784938813.461015:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342572032 00002000:00010000:2.0:1784938813.461702:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.461711:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000115f2248/0xcd9d312a94a092bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.461728:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.461733:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.461741:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000115f2248/0xcd9d312a94a092bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.461793:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000115f2248/0xcd9d312a94a092bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.461805:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000115f2248/0xcd9d312a94a092bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.461814:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000115f2248/0xcd9d312a94a092bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.462891:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938813.464396:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.464409:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bce5868/0xcd9d312a94a092c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464431:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.464437:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.464445:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bce5868/0xcd9d312a94a092c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464462:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bce5868/0xcd9d312a94a092c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464474:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bce5868/0xcd9d312a94a092c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464496:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bce5868/0xcd9d312a94a092c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464520:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784938813.464538:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938813.464547:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000115f2248/0xcd9d312a94a092bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464556:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.464562:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000115f2248/0xcd9d312a94a092bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464575:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000115f2248/0xcd9d312a94a092bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464597:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000115f2248/0xcd9d312a94a092bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464605:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000115f2248/0xcd9d312a94a092bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464629:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.464633:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bce5868/0xcd9d312a94a092c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464652:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609c47e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.464655:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bce5868/0xcd9d312a94a092c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464664:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bce5868/0xcd9d312a94a092c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464675:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bce5868/0xcd9d312a94a092c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464684:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bce5868/0xcd9d312a94a092c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.464698:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.464699:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.464701:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938813.464898:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.464905:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbd12096/0xcd9d312a94a092c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.464915:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.464918:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.464923:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbd12096/0xcd9d312a94a092c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.464937:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbd12096/0xcd9d312a94a092c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.464946:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbd12096/0xcd9d312a94a092c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.464954:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbd12096/0xcd9d312a94a092c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.464976:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938813.465400:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.465407:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002029d5fa/0xcd9d312a94a092d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.465417:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=967s v=(0 0) 00002000:00010000:2.0:1784938813.465426:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.465426:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.465431:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002029d5fa/0xcd9d312a94a092d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465432:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f472864/0xcd9d312a94a092d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465441:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.465442:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002029d5fa/0xcd9d312a94a092d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465444:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.465449:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f472864/0xcd9d312a94a092d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.465451:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002029d5fa/0xcd9d312a94a092d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465459:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f472864/0xcd9d312a94a092d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.465459:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002029d5fa/0xcd9d312a94a092d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465471:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f472864/0xcd9d312a94a092d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.465476:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784938813.465481:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f472864/0xcd9d312a94a092d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465494:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938813.465499:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbd12096/0xcd9d312a94a092c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465506:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.465510:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbd12096/0xcd9d312a94a092c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465518:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbd12096/0xcd9d312a94a092c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465531:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbd12096/0xcd9d312a94a092c9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465538:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbd12096/0xcd9d312a94a092c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465552:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.465555:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002029d5fa/0xcd9d312a94a092d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465570:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.465574:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002029d5fa/0xcd9d312a94a092d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465582:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002029d5fa/0xcd9d312a94a092d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465593:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002029d5fa/0xcd9d312a94a092d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465601:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002029d5fa/0xcd9d312a94a092d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465615:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.465617:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.465619:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.465630:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938813.465637:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.465640:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f472864/0xcd9d312a94a092d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465647:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.465650:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f472864/0xcd9d312a94a092d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465669:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f472864/0xcd9d312a94a092d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465681:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f472864/0xcd9d312a94a092d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465688:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f472864/0xcd9d312a94a092d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.465702:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.465704:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.465706:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938813.465801:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.465807:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3638383/0xcd9d312a94a092de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.465815:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.465819:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.465823:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3638383/0xcd9d312a94a092de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.465833:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3638383/0xcd9d312a94a092de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.465842:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3638383/0xcd9d312a94a092de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.465856:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3638383/0xcd9d312a94a092de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.465871:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938813.466137:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.466142:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3638383/0xcd9d312a94a092de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.466149:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.466153:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3638383/0xcd9d312a94a092de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.466161:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3638383/0xcd9d312a94a092de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.466172:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3638383/0xcd9d312a94a092de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.466192:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3638383/0xcd9d312a94a092de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.466206:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.466208:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.466210:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938813.466278:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938813.466286:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938813.466352:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784938813.466370:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30627:x1871643342572032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938813.466394:0:33795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938813.466412:0:33795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460290ac00/0xcd9d312a94a092e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a092b4 expref: -99 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.466439:0:33795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460290ac00/0xcd9d312a94a092e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a092b4 expref: 12 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.466450:0:33795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460290ac00/0xcd9d312a94a092e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a092b4 expref: 12 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.466456:0:33795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290ac00, rc 0) 00000100:00100000:1.0:1784938813.466560:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342572032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (5783us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938813.466566:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784938813.466638:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342572032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938813.466659:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a092b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a092e5 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.466680:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a092b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a092e5 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938813.466787:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342572160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.466825:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938813.466864:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938813.466880:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342572160 00000100:00100000:1.0:1784938813.466886:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342572160 00000100:00100000:1.0:1784938813.466917:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784938813.466924:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342572160:12345-0@lo:501:ll_cfg_requeue.0 00002000:00010000:2.0:1784938813.467186:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.467193:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098629ca1/0xcd9d312a94a092ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467204:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.467209:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.467214:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098629ca1/0xcd9d312a94a092ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467223:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098629ca1/0xcd9d312a94a092ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467232:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098629ca1/0xcd9d312a94a092ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467239:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098629ca1/0xcd9d312a94a092ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467255:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938813.467264:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.467275:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098629ca1/0xcd9d312a94a092ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467282:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.467286:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098629ca1/0xcd9d312a94a092ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467293:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098629ca1/0xcd9d312a94a092ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467371:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098629ca1/0xcd9d312a94a092ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467379:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098629ca1/0xcd9d312a94a092ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467396:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.467398:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.467400:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938813.467731:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.467738:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ce2437/0xcd9d312a94a092f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467747:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.467841:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.467846:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081ce2437/0xcd9d312a94a092f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467867:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081ce2437/0xcd9d312a94a092f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467876:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ce2437/0xcd9d312a94a092f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467883:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081ce2437/0xcd9d312a94a092f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.467899:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784938813.468491:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.468499:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a092fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.468509:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.468513:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.468518:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a092fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.468528:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a092fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.468537:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a092fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.468558:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a092fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.468575:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784938813.469184:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.469193:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a09301 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469203:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.469206:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.469211:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a09301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469221:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a09301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469230:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a09301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469238:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a09301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469257:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784938813.469274:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784938813.469282:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081ce2437/0xcd9d312a94a092f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469299:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.469370:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ce2437/0xcd9d312a94a092f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469381:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ce2437/0xcd9d312a94a092f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469400:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081ce2437/0xcd9d312a94a092f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469408:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081ce2437/0xcd9d312a94a092f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469428:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938813.469431:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a092fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469438:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.469441:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a092fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469449:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a092fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469460:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a092fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469474:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4207314/0xcd9d312a94a092fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469492:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.469496:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a09301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469502:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.469506:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a09301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469514:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a09301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469524:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a09301 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469531:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccbc2647/0xcd9d312a94a09301 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.469542:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.469544:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.469546:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938813.470196:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.470203:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09308 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.470221:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.470224:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.470229:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.470239:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.470247:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.470255:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.470276:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938813.470287:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.470291:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.470298:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.470301:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.470372:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09308 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.470396:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09308 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.470403:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09308 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.470419:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.470421:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.470423:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938813.471674:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.471685:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0930f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.471700:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.471703:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.471709:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0930f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.471720:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0930f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.471730:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0930f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.471738:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0930f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.471808:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938813.471825:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.471831:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0930f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.471839:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.471843:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0930f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.471853:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0930f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.471869:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0930f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.471876:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006daae1b2/0xcd9d312a94a0930f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.471896:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.471898:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.471899:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938813.472598:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342572160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5665us (5764us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938813.472613:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1784938813.472678:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938813.472684:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938813.473274:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342572160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.473353:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342572288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.473412:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938813.473442:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938813.473462:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342572288 00000100:00100000:1.0:1784938813.473469:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342572288 00000100:00100000:1.0:1784938813.473516:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784938813.473525:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342572288:12345-0@lo:503:ll_cfg_requeue.0 00002000:00010000:2.0:1784938813.474625:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.474636:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09316 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.474654:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.474664:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.474672:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.474688:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.474698:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.474706:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.474721:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938813.474734:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.474740:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.474748:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.475442:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.475457:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.475480:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09316 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.475500:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09316 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.475522:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.475524:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.475527:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938813.477054:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342572288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3515us (3628us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938813.477082:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00002000:00010000:2.0:1784938813.477600:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.477610:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a0931d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.477628:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.477634:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.477642:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a0931d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.477658:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a0931d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.477669:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a0931d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.477677:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a0931d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.477705:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938813.478637:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.478647:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37f2d06/0xcd9d312a94a09324 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.478661:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.478665:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.478670:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d37f2d06/0xcd9d312a94a09324 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.478683:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d37f2d06/0xcd9d312a94a09324 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.478693:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37f2d06/0xcd9d312a94a09324 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.478701:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d37f2d06/0xcd9d312a94a09324 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.478722:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784938813.479181:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.479188:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000453eda87/0xcd9d312a94a0932b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.479203:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.479206:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.479211:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000453eda87/0xcd9d312a94a0932b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.479220:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000453eda87/0xcd9d312a94a0932b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.479229:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000453eda87/0xcd9d312a94a0932b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.479236:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000453eda87/0xcd9d312a94a0932b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.479261:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784938813.479276:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784938813.479291:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a0931d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479408:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.479415:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a0931d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479427:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a0931d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479451:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a0931d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479460:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a0931d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479486:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938813.479490:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d37f2d06/0xcd9d312a94a09324 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479498:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.479502:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37f2d06/0xcd9d312a94a09324 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479510:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37f2d06/0xcd9d312a94a09324 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479534:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d37f2d06/0xcd9d312a94a09324 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479543:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d37f2d06/0xcd9d312a94a09324 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479561:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.479564:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000453eda87/0xcd9d312a94a0932b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479571:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.479574:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000453eda87/0xcd9d312a94a0932b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938813.479577:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.479582:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000453eda87/0xcd9d312a94a0932b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.479583:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b67af503/0xcd9d312a94a09332 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479592:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000453eda87/0xcd9d312a94a0932b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.479592:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.479595:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.479600:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000453eda87/0xcd9d312a94a0932b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.479601:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b67af503/0xcd9d312a94a09332 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.479612:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b67af503/0xcd9d312a94a09332 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479615:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.479617:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.479623:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938813.479631:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b67af503/0xcd9d312a94a09332 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.479638:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b67af503/0xcd9d312a94a09332 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.479656:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938813.479659:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.479663:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b67af503/0xcd9d312a94a09332 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479670:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.479674:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b67af503/0xcd9d312a94a09332 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479682:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b67af503/0xcd9d312a94a09332 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479692:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b67af503/0xcd9d312a94a09332 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479699:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b67af503/0xcd9d312a94a09332 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.479711:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.479712:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.479713:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938813.480161:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938813.480167:0:31425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a09339 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.480176:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=967s v=(0 0) 00010000:00010000:2.0:1784938813.480179:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938813.480183:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a09339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.480200:0:31425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a09339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.480208:0:31425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a09339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.480215:0:31425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a09339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.480229:0:31425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938813.480238:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.480241:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a09339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.480248:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.480251:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a09339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.480258:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a09339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.480269:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a09339 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.480277:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8aefd03/0xcd9d312a94a09339 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.480296:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.480298:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.480422:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1784938813.480846:0:31425:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:40 00000100:00100000:2.0:1784938813.480975:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:33824:x1871643342571520:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 Request processed in 90046us (90451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938813.480986:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 176 00000100:00100000:2.0:1784938813.481955:0:33824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603680000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:33824:1871643342571520:192.168.202.104@tcp:5:osp-pre-1-0.0 00000004:00080000:2.0:1784938813.481977:0:33824:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x28:0x0] 00000100:00100000:2.0:1784938813.482256:0:33824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:33824:1871643342572416:192.168.202.104@tcp:5:osp-pre-1-0.0 00000100:00100000:2.0:1784938813.482454:0:33824:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe61780 going to sleep for 11 seconds 00002000:00010000:0.0:1784938813.486636:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.486653:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae48a9a6/0xcd9d312a94a09340 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.486675:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.486680:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.486688:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae48a9a6/0xcd9d312a94a09340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.486705:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae48a9a6/0xcd9d312a94a09340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.486717:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae48a9a6/0xcd9d312a94a09340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.487357:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938813.487651:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938813.487709:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342572416 00000100:00100000:1.0:1784938813.487721:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342572416 00010000:00010000:0.0:1784938813.492564:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae48a9a6/0xcd9d312a94a09340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.492649:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938813.494960:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.494976:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae48a9a6/0xcd9d312a94a09340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.495010:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.495016:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae48a9a6/0xcd9d312a94a09340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.495036:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae48a9a6/0xcd9d312a94a09340 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.495066:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae48a9a6/0xcd9d312a94a09340 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.495088:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae48a9a6/0xcd9d312a94a09340 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.495124:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.495127:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.495129:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938813.498524:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 178 00000100:00100000:1.0:1784938813.498540:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:33824:x1871643342572416:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1784938813.498620:0:33065:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 66 00002000:00080000:1.0:1784938813.501832:0:33065:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 74 00002000:00010000:0.0:1784938813.504438:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.504462:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a63ddcae/0xcd9d312a94a09347 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.504486:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.504491:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.504499:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a63ddcae/0xcd9d312a94a09347 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.504518:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a63ddcae/0xcd9d312a94a09347 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.504530:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a63ddcae/0xcd9d312a94a09347 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.504538:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a63ddcae/0xcd9d312a94a09347 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.504570:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938813.505202:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.505211:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064b24f96/0xcd9d312a94a0934e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.505223:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.505233:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.505239:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064b24f96/0xcd9d312a94a0934e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.505251:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064b24f96/0xcd9d312a94a0934e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.505260:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064b24f96/0xcd9d312a94a0934e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.505267:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064b24f96/0xcd9d312a94a0934e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.505291:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784938813.505627:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.505633:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603c561f/0xcd9d312a94a09355 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.505642:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.505645:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.505649:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603c561f/0xcd9d312a94a09355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.505659:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603c561f/0xcd9d312a94a09355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.505668:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603c561f/0xcd9d312a94a09355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.505682:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000603c561f/0xcd9d312a94a09355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.505691:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784938813.506094:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.506101:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007af49af6/0xcd9d312a94a0935c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506110:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.506114:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.506118:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007af49af6/0xcd9d312a94a0935c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506127:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007af49af6/0xcd9d312a94a0935c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506135:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007af49af6/0xcd9d312a94a0935c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506142:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007af49af6/0xcd9d312a94a0935c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506151:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1784938813.506463:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.506469:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c59ba312/0xcd9d312a94a09363 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506483:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.506486:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.506490:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c59ba312/0xcd9d312a94a09363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506500:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c59ba312/0xcd9d312a94a09363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506509:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c59ba312/0xcd9d312a94a09363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506516:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c59ba312/0xcd9d312a94a09363 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506525:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1784938813.506882:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.506889:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000800c4194/0xcd9d312a94a0936a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506899:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.506902:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.506907:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000800c4194/0xcd9d312a94a0936a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506917:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000800c4194/0xcd9d312a94a0936a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506938:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000800c4194/0xcd9d312a94a0936a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506946:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000800c4194/0xcd9d312a94a0936a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.506955:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1784938813.507281:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.507288:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002731d04/0xcd9d312a94a09371 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.507298:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.507301:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.507306:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002731d04/0xcd9d312a94a09371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.507315:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002731d04/0xcd9d312a94a09371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.507323:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002731d04/0xcd9d312a94a09371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.507332:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002731d04/0xcd9d312a94a09371 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.507352:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1784938813.507641:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.507648:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4863037/0xcd9d312a94a09378 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.507656:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.507659:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.507663:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4863037/0xcd9d312a94a09378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.507672:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4863037/0xcd9d312a94a09378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.507679:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4863037/0xcd9d312a94a09378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.507686:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4863037/0xcd9d312a94a09378 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.507693:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1784938813.508165:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1784938813.508176:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a63ddcae/0xcd9d312a94a09347 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508186:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.508192:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a63ddcae/0xcd9d312a94a09347 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508216:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a63ddcae/0xcd9d312a94a09347 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508238:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a63ddcae/0xcd9d312a94a09347 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508247:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a63ddcae/0xcd9d312a94a09347 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508279:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1784938813.508283:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064b24f96/0xcd9d312a94a0934e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508290:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.508293:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064b24f96/0xcd9d312a94a0934e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508301:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064b24f96/0xcd9d312a94a0934e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508312:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064b24f96/0xcd9d312a94a0934e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508319:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064b24f96/0xcd9d312a94a0934e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508347:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784938813.508351:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000603c561f/0xcd9d312a94a09355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508358:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.508361:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000603c561f/0xcd9d312a94a09355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508370:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000603c561f/0xcd9d312a94a09355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508381:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000603c561f/0xcd9d312a94a09355 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508388:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603c561f/0xcd9d312a94a09355 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508401:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784938813.508404:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007af49af6/0xcd9d312a94a0935c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508409:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c1600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.508412:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007af49af6/0xcd9d312a94a0935c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508430:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007af49af6/0xcd9d312a94a0935c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508439:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007af49af6/0xcd9d312a94a0935c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508446:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007af49af6/0xcd9d312a94a0935c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508461:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784938813.508465:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c59ba312/0xcd9d312a94a09363 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508471:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.508474:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c59ba312/0xcd9d312a94a09363 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508481:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c59ba312/0xcd9d312a94a09363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508491:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c59ba312/0xcd9d312a94a09363 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508499:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c59ba312/0xcd9d312a94a09363 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508525:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938813.508529:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000800c4194/0xcd9d312a94a0936a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508536:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.508540:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000800c4194/0xcd9d312a94a0936a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508548:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000800c4194/0xcd9d312a94a0936a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508558:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000800c4194/0xcd9d312a94a0936a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508565:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000800c4194/0xcd9d312a94a0936a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508578:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938813.508581:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002731d04/0xcd9d312a94a09371 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508588:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.508591:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002731d04/0xcd9d312a94a09371 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508610:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002731d04/0xcd9d312a94a09371 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508620:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002731d04/0xcd9d312a94a09371 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508628:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002731d04/0xcd9d312a94a09371 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508643:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938813.508647:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4863037/0xcd9d312a94a09378 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508654:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460b0c0400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.508657:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4863037/0xcd9d312a94a09378 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508664:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4863037/0xcd9d312a94a09378 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508673:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4863037/0xcd9d312a94a09378 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508681:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4863037/0xcd9d312a94a09378 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.508709:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938813.508711:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938813.508714:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.509129:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938813.511923:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342572288:0@lo:503:ll_cfg_requeue.0 00000001:00080000:1.0:1784938813.512660:0:33065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967347 00002000:00080000:1.0:1784938813.513539:0:33065:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 82 00000001:00080000:1.0:1784938813.514666:0:33065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967348 00002000:00080000:1.0:1784938813.514979:0:33065:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 90 00010000:00010000:1.0:1784938813.515219:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938813.515922:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.515935:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3b16d9a/0xcd9d312a94a0937f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.515957:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.515973:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.515981:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3b16d9a/0xcd9d312a94a0937f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.516009:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3b16d9a/0xcd9d312a94a0937f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.516023:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3b16d9a/0xcd9d312a94a0937f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.516032:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3b16d9a/0xcd9d312a94a0937f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.516054:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938813.516066:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938813.516073:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3b16d9a/0xcd9d312a94a0937f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.516082:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938813.516087:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3b16d9a/0xcd9d312a94a0937f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.516098:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3b16d9a/0xcd9d312a94a0937f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.516118:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3b16d9a/0xcd9d312a94a0937f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.516137:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3b16d9a/0xcd9d312a94a0937f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.516160:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938813.516167:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938813.516169:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784938813.517330:0:33065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967349 00002000:00010000:0.0:1784938813.523377:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.523393:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a09386 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.523414:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.523419:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.523426:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a09386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.523444:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a09386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.523457:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a09386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.523465:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a09386 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.527076:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938813.527793:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.527813:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0859cf/0xcd9d312a94a0938d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.528045:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938813.528056:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a09386 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.528068:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938813.528073:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a09386 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.528087:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a09386 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.528114:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a09386 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.528122:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024377eac/0xcd9d312a94a09386 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.528149:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.528151:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938813.528161:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784938813.529592:0:33838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 39 00000020:01000000:3.0:1784938813.529675:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-38 (rc=0) 10000000:01000000:3.0:1784938813.529710:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784938813.530206:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a092b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a092e5 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.530221:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a092b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a092e5 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938813.530233:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784938813.530237:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1784938813.530240:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784938813.530291:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742044a00/0xcd9d312a94a09394 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.530301:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974742044a00/0xcd9d312a94a09394 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.530315:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974742044a00/0xcd9d312a94a09394 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938813.530350:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342572544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938813.530441:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938813.530509:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470c1f2a80 going to sleep for 11 seconds 00010000:00010000:0.0:1784938813.530711:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.530717:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.530821:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d0859cf/0xcd9d312a94a0938d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.531944:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d0859cf/0xcd9d312a94a0938d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.531957:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0859cf/0xcd9d312a94a0938d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.531966:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d0859cf/0xcd9d312a94a0938d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.532004:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938813.532633:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938813.532642:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a0939b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.532658:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=967s v=(0 0) 00010000:00010000:0.0:1784938813.532662:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938813.532669:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a0939b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.532683:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a0939b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.532700:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a0939b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.532708:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a0939b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.532731:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784938813.532782:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938813.532790:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d0859cf/0xcd9d312a94a0938d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.532799:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938813.532804:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0859cf/0xcd9d312a94a0938d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.532814:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0859cf/0xcd9d312a94a0938d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.534935:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d0859cf/0xcd9d312a94a0938d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.534961:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d0859cf/0xcd9d312a94a0938d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.535009:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938813.535024:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a0939b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.535032:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938813.535038:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a0939b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.535049:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a0939b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.535062:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a0939b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.535069:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ebf008a/0xcd9d312a94a0939b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.535084:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938813.535087:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938813.535089:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938813.535454:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342572544 00000100:00100000:1.0:1784938813.535469:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342572544 00000100:00100000:1.0:1784938813.535544:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784938813.535556:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342572544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938813.535579:0:33793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938813.535600:0:33793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460290b200/0xcd9d312a94a093a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a09394 expref: -99 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.535633:0:33793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460290b200/0xcd9d312a94a093a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a09394 expref: 13 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.535645:0:33793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460290b200/0xcd9d312a94a093a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a09394 expref: 13 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.535665:0:33793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290b200, rc 0) 00000100:00100000:1.0:1784938813.537140:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342572544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1575us (6688us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938813.537154:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1784938813.537251:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938813.539093:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938813.539110:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a093a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.539131:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=967s v=(0 0) 00010000:00010000:1.0:1784938813.539136:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938813.539143:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a093a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.539161:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a093a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.539173:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a093a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.539181:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a093a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.539214:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938813.539684:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938813.539691:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a093b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.539708:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=967s v=(0 0) 00010000:00010000:1.0:1784938813.539711:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938813.539716:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a093b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.540963:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938813.540977:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a093a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.541001:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290ae00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938813.541007:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a093a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.541035:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a093a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.541061:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a093a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.541070:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a093a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.541096:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938813.541098:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938813.541100:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938813.542332:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:33824:x1871643342572416:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 Request processed in 43781us (54675us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1784938813.542347:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 178 00000020:00080000:0.0:1784938813.542356:0:33065:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00010000:00010000:1.0:1784938813.542466:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a093b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.542484:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a093b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.542492:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a093b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.542519:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938813.542924:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938813.542932:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a093b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.542943:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290be00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938813.542947:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a093b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.542957:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a093b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.542996:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a093b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.543005:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a093b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.543029:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938813.543031:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938813.543033:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938813.543346:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938813.543354:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a093b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.543367:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=967s v=(0 0) 00010000:00010000:1.0:1784938813.543372:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938813.543379:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a093b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.543391:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a093b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.543411:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a093b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.543418:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a093b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938813.543808:0:33824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:33824:1871643342572416:192.168.202.104@tcp:5:osp-pre-1-0.0 00010000:00010000:1.0:1784938813.543907:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938813.544465:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938813.544472:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a093be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.544484:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=967s v=(0 0) 00010000:00010000:1.0:1784938813.544487:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938813.544493:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a093be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.544504:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a093be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.544513:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a093be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.544520:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a093be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938813.544567:0:33824:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1784938813.546524:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342572544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938813.546556:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974742044a00/0xcd9d312a94a09394 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093a2 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.546570:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974742044a00/0xcd9d312a94a09394 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a093a2 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938813.546674:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342572672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938813.546833:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938813.546890:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470c1f2a80 going to sleep for 11 seconds 00010000:00010000:0.0:1784938813.557152:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938813.557177:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a093b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.557196:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290ba00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938813.557202:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a093b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.557216:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a093b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.557248:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a093b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.557257:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a093b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938813.557363:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342572672 00000100:00100000:0.0:1784938813.557377:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342572672 00000100:00100000:0.0:1784938813.557468:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784938813.557479:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342572672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.558148:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342572672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 668us (11313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938813.558158:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784938813.558684:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342572672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.558825:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342572800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.558883:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938813.558922:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026db540 going to sleep for 11 seconds 00010000:00010000:0.0:1784938813.558935:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938813.558943:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a093be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.558956:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:0.0:1784938813.558961:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a093be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.558972:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a093be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.559008:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a093be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.559031:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938813.559033:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938813.559036:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938813.565597:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784938813.565620:0:31428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a093be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938813.565699:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342572800 00000100:00100000:1.0:1784938813.565713:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342572800 00000100:00100000:1.0:1784938813.566000:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784938813.566012:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974705196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342572800:12345-0@lo:503:ll_cfg_requeue.0 00010000:00010000:0.0:1784938813.566555:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938813.590642:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938813.590661:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a093c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.590684:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=967s v=(0 0) 00010000:00010000:1.0:1784938813.590689:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938813.590697:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a093c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.590713:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a093c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.592458:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a093c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.592483:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a093c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.592534:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938813.593857:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938813.593871:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a093c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.593886:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290bc00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938813.593892:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a093c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.593905:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a093c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.593932:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a093c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.593941:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a093c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.594003:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938813.594005:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938813.594008:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938813.594540:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974705196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342572800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 28523us (35650us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938813.594554:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00002000:00080000:1.0:1784938813.595123:0:31428:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:41 00000100:00100000:1.0:1784938813.595205:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:33822:x1871643342571648:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 Request processed in 170494us (204464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938813.595215:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 177 00000100:00100000:3.0:1784938813.599299:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342572800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.603617:0:33822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:33822:1871643342571648:192.168.202.104@tcp:5:osp-pre-0-0.0 00000004:00080000:1.0:1784938813.603647:0:33822:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x29:0x0] 00000100:00100000:1.0:1784938813.603720:0:33822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603683100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:33822:1871643342572928:192.168.202.104@tcp:5:osp-pre-0-0.0 00000100:00100000:1.0:1784938813.603887:0:33822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746035c8f00 going to sleep for 11 seconds 00000040:00080000:1.0:1784938813.604494:0:33840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 8 00000020:01000000:1.0:1784938813.604574:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-7 (rc=0) 10000000:01000000:1.0:1784938813.604603:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784938813.604618:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742044a00/0xcd9d312a94a09394 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093a2 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.604633:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974742044a00/0xcd9d312a94a09394 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093a2 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938813.604645:0:30627:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784938813.604648:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff974724c7c800 from 7 10000000:01000000:1.0:1784938813.604652:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938813.604693:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290b400/0xcd9d312a94a093cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.604718:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460290b400/0xcd9d312a94a093cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.604730:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460290b400/0xcd9d312a94a093cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938813.604781:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.604848:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938813.604875:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746035c8780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938813.604899:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342573056 00000100:00100000:1.0:1784938813.604906:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342573056 00000100:00100000:1.0:1784938813.604955:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784938813.604965:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974736075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342573056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938813.604981:0:33795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938813.605012:0:33795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460290a600/0xcd9d312a94a093d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a093cc expref: -99 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.605039:0:33795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460290a600/0xcd9d312a94a093d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a093cc expref: 14 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.605052:0:33795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460290a600/0xcd9d312a94a093d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a093cc expref: 14 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.605062:0:33795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a600, rc 0) 00000100:00100000:1.0:1784938813.605103:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974736075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342573056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938813.605110:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784938813.605175:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938813.605190:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460290b400/0xcd9d312a94a093cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093d3 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.605200:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460290b400/0xcd9d312a94a093cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a093d3 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938813.605253:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.605277:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938813.605291:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746035c8780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938813.605305:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342573184 00000100:00100000:1.0:1784938813.605308:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342573184 00000100:00100000:1.0:1784938813.605329:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784938813.605336:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974736076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342573184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.605662:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974736076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342573184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938813.605670:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784938813.605700:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.605727:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.605790:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938813.605803:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746035c8780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938813.605814:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342573312 00000100:00100000:1.0:1784938813.605818:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342573312 00000100:00100000:1.0:1784938813.605837:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784938813.605843:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974736074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342573312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.606046:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974736074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342573312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938813.606060:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784938813.606096:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938813.607129:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938813.608912:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342572928 00000100:00100000:3.0:1784938813.608930:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342572928 00000100:00100000:3.0:1784938813.609014:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 179 00000100:00100000:3.0:1784938813.609025:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:33822:x1871643342572928:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 00002000:00080000:3.0:1784938813.609100:0:31425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 66 00000040:00080000:2.0:1784938813.619305:0:33841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784938813.619603:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784938813.619639:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938813.619656:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290b400/0xcd9d312a94a093cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093d3 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.619670:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460290b400/0xcd9d312a94a093cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093d3 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938813.619682:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784938813.619685:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff974603c37000 from 39 10000000:01000000:1.0:1784938813.619688:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938813.619778:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290a000/0xcd9d312a94a093da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.619787:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460290a000/0xcd9d312a94a093da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938813.619801:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460290a000/0xcd9d312a94a093da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938813.619844:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.619941:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938813.620006:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746035c8780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938813.620308:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342573440 00000100:00100000:2.0:1784938813.620316:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342573440 00000100:00100000:2.0:1784938813.620380:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784938813.620391:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974736076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342573440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938813.620410:0:33795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938813.620431:0:33795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974709892400/0xcd9d312a94a093e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a093da expref: -99 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.620463:0:33795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974709892400/0xcd9d312a94a093e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a093da expref: 15 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.620475:0:33795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974709892400/0xcd9d312a94a093e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a093da expref: 15 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.620485:0:33795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892400, rc 0) 00000100:00100000:2.0:1784938813.620538:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974736076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342573440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938813.620546:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784938813.620605:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938813.620622:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460290a000/0xcd9d312a94a093da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093e1 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.620632:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460290a000/0xcd9d312a94a093da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a093e1 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938813.620710:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938813.622408:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938813.622451:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe613c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938813.624023:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342573568 00000100:00100000:1.0:1784938813.624036:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342573568 00000100:00100000:1.0:1784938813.624108:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784938813.624120:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974736075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342573568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938813.624429:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974736075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342573568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (2024us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938813.624439:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00002000:00080000:3.0:1784938813.625341:0:31425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 74 00000100:00100000:2.0:1784938813.628767:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938813.628865:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938813.628965:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938813.629025:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938813.629070:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342573696 00000100:00100000:2.0:1784938813.629079:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342573696 00000100:00100000:2.0:1784938813.629138:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784938813.629149:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974736074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342573696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938813.629400:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974736074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342573696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938813.629409:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784938813.629466:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573696:0@lo:503:ll_cfg_requeue.0 00000001:00080000:3.0:1784938813.631040:0:31425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967347 00000040:00080000:0.0:1784938813.631792:0:33843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 39 00000020:01000000:2.0:1784938813.632330:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-38 (rc=0) 10000000:01000000:2.0:1784938813.632356:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784938813.632371:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290a000/0xcd9d312a94a093da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093e1 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.632385:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460290a000/0xcd9d312a94a093da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093e1 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938813.632396:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784938813.632417:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1784938813.632421:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784938813.632468:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974709892c00/0xcd9d312a94a093e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.632478:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974709892c00/0xcd9d312a94a093e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.632502:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974709892c00/0xcd9d312a94a093e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938813.632533:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938813.632619:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938813.632680:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe613c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938813.632968:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342573824 00000100:00100000:0.0:1784938813.632977:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342573824 00000100:00100000:0.0:1784938813.633044:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784938813.633061:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974736077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342573824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938813.633077:0:33794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938813.633097:0:33794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97473ea04600/0xcd9d312a94a093ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a093e8 expref: -99 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.633126:0:33794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97473ea04600/0xcd9d312a94a093ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a093e8 expref: 16 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.633138:0:33794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97473ea04600/0xcd9d312a94a093ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a093e8 expref: 16 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.633149:0:33794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04600, rc 0) 00000100:00100000:0.0:1784938813.633200:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974736077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342573824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938813.633208:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784938813.633264:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938813.633281:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974709892c00/0xcd9d312a94a093e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093ef expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.633307:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974709892c00/0xcd9d312a94a093e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a093ef expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938813.633370:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.633395:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938813.633409:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026db480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938813.633422:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342573952 00000100:00100000:0.0:1784938813.633425:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342573952 00000100:00100000:0.0:1784938813.633443:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784938813.633448:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342573952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.637396:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342573952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3933us (3985us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938813.637416:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00002000:00080000:2.0:1784938813.637910:0:31425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 82 00000001:00080000:2.0:1784938813.638650:0:31425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967348 00002000:00080000:2.0:1784938813.638785:0:31425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 90 00000001:00080000:2.0:1784938813.639381:0:31425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967349 00000100:00100000:2.0:1784938813.639575:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:33822:x1871643342572928:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 Request processed in 30545us (32446us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1784938813.639588:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 179 00000020:00080000:2.0:1784938813.639595:0:31425:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00100000:2.0:1784938813.639934:0:33822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603683100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:33822:1871643342572928:192.168.202.104@tcp:5:osp-pre-0-0.0 00000004:00080000:2.0:1784938813.639956:0:33822:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00000100:00100000:0.0:1784938813.640658:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342573952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.640741:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.641681:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938813.641908:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026db480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938813.648958:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342574080 00000100:00100000:2.0:1784938813.648980:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342574080 00000100:00100000:2.0:1784938813.649076:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784938813.649089:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342574080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938813.673035:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342574080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 23933us (31342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938813.673079:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784938813.680093:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784938813.692543:0:33846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 11 00000020:01000000:0.0:1784938813.700255:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-10 (rc=0) 10000000:01000000:0.0:1784938813.700909:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784938813.700927:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974709892c00/0xcd9d312a94a093e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093ef expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.700943:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974709892c00/0xcd9d312a94a093e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093ef expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938813.700966:0:30627:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784938813.700969:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff97473bae19c0 from 1 10000000:01000000:0.0:1784938813.700972:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784938813.701039:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97473ea04e00/0xcd9d312a94a093f6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.702158:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97473ea04e00/0xcd9d312a94a093f6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.702183:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97473ea04e00/0xcd9d312a94a093f6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938813.702223:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.703170:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938813.703229:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938813.703285:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342574208 00000100:00100000:0.0:1784938813.706738:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342574208 00000100:00100000:0.0:1784938813.706864:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784938813.706877:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342574208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938813.706901:0:33794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938813.706928:0:33794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97473ea04a00/0xcd9d312a94a093fd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a093f6 expref: -99 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.706962:0:33794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97473ea04a00/0xcd9d312a94a093fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a093f6 expref: 17 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.706975:0:33794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97473ea04a00/0xcd9d312a94a093fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a093f6 expref: 17 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.707012:0:33794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04a00, rc 0) 00000100:00100000:0.0:1784938813.707115:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342574208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (3947us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938813.707123:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784938813.707214:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938813.707237:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97473ea04e00/0xcd9d312a94a093f6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093fd expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.707248:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97473ea04e00/0xcd9d312a94a093f6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a093fd expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938813.707276:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784938813.707282:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97473ea04e00/0xcd9d312a94a093f6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093fd expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.707292:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97473ea04e00/0xcd9d312a94a093f6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a093fd expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938813.707314:0:30627:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784938813.707318:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff974603c37000 from 7 10000000:01000000:0.0:1784938813.707321:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938813.707351:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97473ea05e00/0xcd9d312a94a09404 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.707360:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97473ea05e00/0xcd9d312a94a09404 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.707370:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97473ea05e00/0xcd9d312a94a09404 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938813.707402:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.707445:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938813.707495:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938813.707777:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342574336 00000100:00100000:2.0:1784938813.707783:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342574336 00000100:00100000:2.0:1784938813.707818:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784938813.707835:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342574336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938813.707844:0:33795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938813.707856:0:33795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974709892800/0xcd9d312a94a0940b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a09404 expref: -99 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.707872:0:33795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974709892800/0xcd9d312a94a0940b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a09404 expref: 18 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.707883:0:33795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974709892800/0xcd9d312a94a0940b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a09404 expref: 18 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.707891:0:33795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892800, rc 0) 00000100:00100000:2.0:1784938813.707926:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342574336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938813.707933:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784938813.707962:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938813.707973:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97473ea05e00/0xcd9d312a94a09404 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a0940b expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938813.707982:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97473ea05e00/0xcd9d312a94a09404 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a0940b expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938813.708142:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938813.708178:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938813.708198:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938813.708212:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342574464 00000100:00100000:2.0:1784938813.708216:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342574464 00000100:00100000:2.0:1784938813.708257:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784938813.708264:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342574464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938813.709266:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342574464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 996us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938813.709276:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784938813.710878:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.710954:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.711113:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938813.711160:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718318cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938813.711185:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342574592 00000100:00100000:0.0:1784938813.711193:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342574592 00000100:00100000:0.0:1784938813.711252:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784938813.711261:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342574592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.711698:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342574592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 436us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938813.711707:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784938813.711806:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784938813.715644:0:33847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784938813.717997:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784938813.718044:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938813.718171:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97473ea05e00/0xcd9d312a94a09404 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a0940b expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.718186:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97473ea05e00/0xcd9d312a94a09404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a0940b expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938813.718199:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784938813.718213:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97473bae19c0 from 1 10000000:01000000:0.0:1784938813.718217:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784938813.718274:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97473ea05800/0xcd9d312a94a09412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.718283:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97473ea05800/0xcd9d312a94a09412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.718936:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97473ea05800/0xcd9d312a94a09412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938813.718971:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.720169:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938813.720244:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938813.720429:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342574720 00000100:00100000:3.0:1784938813.720442:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342574720 00000100:00100000:3.0:1784938813.720511:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784938813.720522:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342574720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938813.720541:0:33795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938813.720564:0:33795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974742045400/0xcd9d312a94a09419 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a09412 expref: -99 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.720597:0:33795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974742045400/0xcd9d312a94a09419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a09412 expref: 19 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.720612:0:33795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974742045400/0xcd9d312a94a09419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a09412 expref: 19 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938813.720636:0:33795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045400, rc 0) 00000100:00100000:3.0:1784938813.720693:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342574720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938813.720701:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784938813.721425:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938813.721449:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97473ea05800/0xcd9d312a94a09412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09419 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.721460:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97473ea05800/0xcd9d312a94a09412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09419 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938813.721552:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938813.721592:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938813.721623:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97473a822f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938813.723915:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342574848 00000100:00100000:3.0:1784938813.723933:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342574848 00000100:00100000:3.0:1784938813.724012:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784938813.724024:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342574848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938813.726419:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342574848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2387us (4816us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784938813.726438:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784938813.736416:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342574848:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1784938813.737867:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784938813.737887:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97473ea05800/0xcd9d312a94a09412 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09419 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.737920:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97473ea05800/0xcd9d312a94a09412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09419 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938813.747240:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784938813.992202:0:31424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784938813.992638:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00010000:00010000:0.0:1784938814.773702:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938815.795231:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784938815.987410:0:32270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784938815.987444:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967350 is committed 00010000:00010000:0.0:1784938816.839337:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938817.856386:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938817.907096:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342575104:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938817.907217:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938817.907225:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342574976:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938817.907442:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938817.907522:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938817.907632:0:31430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342575104 00000100:00100000:0.0:1784938817.907642:0:31430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342575104 00000100:00100000:1.0:1784938817.907688:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342574976 00000100:00100000:1.0:1784938817.907695:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342574976 00000100:00100000:0.0:1784938817.907706:0:31430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 25 00000100:00100000:0.0:1784938817.907719:0:31430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342575104:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938817.907984:0:31430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 384827392 avail 382730240 00000100:00100000:1.0:1784938817.908058:0:31430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342575104:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 333us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938817.908067:0:31430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 25 00000100:00100000:1.0:1784938817.908089:0:31430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 26 00000100:00100000:1.0:1784938817.908097:0:31430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342574976:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938817.908118:0:31430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 386924544 avail 384827392 00000100:00100000:1.0:1784938817.908149:0:31430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342574976:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 52us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938817.908156:0:31430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 26 00000100:00100000:1.0:1784938817.908315:0:12803:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967350 gen 2 00000100:00100000:1.0:1784938817.908343:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342574976:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938817.908358:0:12803:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967350 gen 2 00000100:00100000:1.0:1784938817.908371:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342575104:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00080000:2.0:1784938817.909275:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938817.909283:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938817.917472:0:24411:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938817.917480:0:24411:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784938817.917489:0:24411:0:(import.c:65:import_set_state_nolock()) ffff974718b1c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938817.917503:0:24411:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff974718b1c800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:1.0:1784938817.917530:0:24411:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974603683100 x1871643342575360/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938817.917550:0:24411:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938817.917554:0:24411:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784938817.917556:0:24411:0:(import.c:65:import_set_state_nolock()) ffff974729ece000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938817.917561:0:24411:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff974729ece000 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:1.0:1784938817.917576:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342575360:192.168.202.104@tcp:38:kworker.0 00000100:00100000:2.0:1784938817.917852:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342575232:0@lo:400:kworker.0 00000100:00100000:2.0:1784938817.917905:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938817.918018:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342575232 00000100:00100000:0.0:1784938817.918026:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342575232 00000100:00100000:0.0:1784938817.918076:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784938817.918085:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12804:x1871643342575232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938817.918148:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12804:x1871643342575232:12345-0@lo:400:kworker.0 Request processed in 64us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938817.918250:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342575232:0@lo:400:kworker.0 00000100:00100000:1.0:1784938817.918313:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938817.918352:0:24411:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974603680000 x1871643342575488/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938817.918368:0:24411:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784938817.918372:0:24411:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784938817.918373:0:24411:0:(import.c:65:import_set_state_nolock()) ffff974703e9d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938817.918379:0:24411:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff974703e9d000 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:1.0:1784938817.918387:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342575488:192.168.202.104@tcp:38:kworker.0 00000100:00100000:1.0:1784938817.918431:0:24411:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974603681c00 x1871643342575616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938817.918447:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342575616:192.168.202.104@tcp:38:kworker.0 00000100:00100000:2.0:1784938817.918509:0:33800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342575360 00000100:00100000:2.0:1784938817.918513:0:33800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342575360 00000100:00100000:2.0:1784938817.918542:0:33800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:2.0:1784938817.918547:0:33800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12801:x1871643342575360:12345-192.168.202.104@tcp:38:kworker.0 00010000:00080000:2.0:1784938817.918569:0:33800:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 971 last 0 00000020:00000080:2.0:1784938817.918609:0:33800:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcd9d312a94a09420 00000004:00100000:2.0:1784938817.918632:0:33800:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938817.919071:0:33800:0:(import.c:65:import_set_state_nolock()) ffff974609ceb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938817.919103:0:33800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12801:x1871643342575360:12345-192.168.202.104@tcp:38:kworker.0 Request processed in 555us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938817.919111:0:33800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:2.0:1784938817.919230:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938817.919248:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938817.919352:0:33801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342575488 00000100:00100000:2.0:1784938817.919356:0:33801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342575488 00000100:00100000:2.0:1784938817.919371:0:33801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342575616 00000100:00100000:2.0:1784938817.919373:0:33801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342575616 00000100:00100000:2.0:1784938817.919383:0:33801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 6 00000100:00100000:2.0:1784938817.919388:0:33801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:12801:x1871643342575488:12345-192.168.202.104@tcp:38:kworker.0 00010000:00080000:2.0:1784938817.919401:0:33801:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 971 last 0 00000020:00000080:2.0:1784938817.919427:0:33801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcd9d312a94a09427 00000004:00100000:2.0:1784938817.919434:0:33801:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938817.919456:0:33801:0:(import.c:65:import_set_state_nolock()) ffff974609cea800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938817.919486:0:33801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12801:x1871643342575488:12345-192.168.202.104@tcp:38:kworker.0 Request processed in 96us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938817.919493:0:33801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 6 00000100:00100000:2.0:1784938817.919506:0:33801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 7 00000100:00100000:2.0:1784938817.919511:0:33801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:12801:x1871643342575616:12345-192.168.202.104@tcp:38:kworker.0 00010000:00080000:2.0:1784938817.919523:0:33801:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 971 last 0 00000020:00000080:2.0:1784938817.919547:0:33801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcd9d312a94a0942e 00000004:00100000:2.0:1784938817.919552:0:33801:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938817.919568:0:33801:0:(import.c:65:import_set_state_nolock()) ffff974609ce9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938817.919594:0:33801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12801:x1871643342575616:12345-192.168.202.104@tcp:38:kworker.0 Request processed in 82us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938817.919600:0:33801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 7 00010000:00080000:2.0:1784938817.920165:0:12801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974603681c00 x1871643342575616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938817.920181:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1784938817.920189:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784938817.920193:0:12801:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784938817.920195:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974703e9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784938817.920201:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342575616:192.168.202.104@tcp:38:kworker.0 00010000:00080000:2.0:1784938817.920215:0:12801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974603680000 x1871643342575488/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938817.920222:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1784938817.923600:0:12801:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff974603680000 x1871643342575488/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938827 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938817.923602:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1784938817.923613:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974729ece000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1784938817.923619:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974729ece000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1784938817.923624:0:12801:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 192.168.202.104@tcp (at 192.168.202.104@tcp) 00000100:00100000:2.0:1784938817.932734:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342575488:192.168.202.104@tcp:38:kworker.0 00010000:00080000:3.0:1784938817.932855:0:12801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974603683100 x1871643342575360/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938817.932881:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1784938817.933808:0:12801:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff974603683100 x1871643342575360/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938827 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938817.933820:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974718b1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784938817.933826:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974718b1c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784938817.933830:0:12801:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 192.168.202.104@tcp (at 192.168.202.104@tcp) 00000100:00100000:3.0:1784938817.933836:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342575360:192.168.202.104@tcp:38:kworker.0 00010000:00010000:0.0:1784938818.870499:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938819.925005:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784938820.463185:0:34085:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784938820.981133:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938822.004638:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1784938822.004721:0:12803:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938805/real 1784938805] req@ffff974602fb4e00 x1871643342566528/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938821 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938822.054345:0:12803:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff974602fb4e00 x1871643342566528/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938821 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:3.0:1784938822.055086:0:12803:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938805/real 1784938805] req@ffff974602fb5c00 x1871643342566656/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938821 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938822.055146:0:12803:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff974602fb5c00 x1871643342566656/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938821 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938822.055174:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:12803:1871643342566528:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938822.055180:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342566656:192.168.202.104@tcp:400:kworker.0 00010000:00010000:3.0:1784938823.027060:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938823.029010:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342576128:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938823.029154:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784938823.029182:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342575744:0@lo:400:kworker.0 00000100:00100000:2.0:1784938823.029245:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938823.029280:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342576256:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938823.029511:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938823.029570:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938823.029620:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342576128 00000100:00100000:2.0:1784938823.029629:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342576128 00000100:00100000:2.0:1784938823.029695:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342576256 00000100:00100000:2.0:1784938823.029699:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342576256 00000100:00100000:2.0:1784938823.029726:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 21 00000100:00100000:2.0:1784938823.029736:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342576128:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938823.029832:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342576128:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 96us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938823.029841:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 21 00000100:00100000:2.0:1784938823.029862:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 22 00000100:00100000:2.0:1784938823.029868:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342576256:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938823.029893:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342576256:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938823.029899:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 22 00000100:00080000:2.0:1784938823.029929:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938823.029935:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938823.030058:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342576256:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938823.030069:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342576128:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938823.030400:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342575872:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938823.030480:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342576384:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938823.030511:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784938823.030520:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342576000:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938823.030545:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342576512:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938823.031395:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342575744 00000100:00100000:3.0:1784938823.031403:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342575744 00000100:00100000:3.0:1784938823.031454:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784938823.031464:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12804:x1871643342575744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938823.031540:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12804:x1871643342575744:12345-0@lo:400:kworker.0 Request processed in 77us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938823.031547:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784938823.031605:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938823.031618:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342576640:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938823.031941:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342575744:0@lo:400:kworker.0 00000100:00100000:2.0:1784938823.032376:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938823.032403:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938823.032435:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938823.032459:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938823.032479:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938823.032604:0:33798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342575872 00000100:00100000:3.0:1784938823.032612:0:33798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342575872 00000100:00100000:3.0:1784938823.032655:0:33798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342576384 00000100:00100000:3.0:1784938823.032658:0:33798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342576384 00000100:00100000:3.0:1784938823.032669:0:33798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342576000 00000100:00100000:3.0:1784938823.032671:0:33798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342576000 00000100:00100000:3.0:1784938823.032686:0:33798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:3.0:1784938823.032692:0:33798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342575872:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938823.032817:0:33801:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784938823.032829:0:33801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1784938823.033079:0:33801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:0.0:1784938823.033089:0:33801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342576384:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938823.048646:0:33798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342575872:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 15931us (16250us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938823.048691:0:33798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:3.0:1784938823.048739:0:33798:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784938823.048769:0:33798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:3.0:1784938823.048785:0:33798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12802:x1871643342576000:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938823.058970:0:33801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342576384:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 25861us (26543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938823.058994:0:33801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:0.0:1784938823.068084:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342576512 00000100:00100000:0.0:1784938823.068105:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342576512 00000100:00100000:0.0:1784938823.068176:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342576640 00000100:00100000:0.0:1784938823.068179:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342576640 00000100:00100000:0.0:1784938823.068203:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 27 00000100:00100000:0.0:1784938823.068216:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342576512:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938823.068273:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 386924544 avail 384827392 00000100:00100000:0.0:1784938823.068372:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342576512:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 158us (35910us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938823.068380:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 27 00000100:00100000:0.0:1784938823.068404:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 28 00000100:00100000:0.0:1784938823.068412:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342576640:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938823.068437:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 384827392 avail 382730240 00000100:00100000:0.0:1784938823.068485:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342576640:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 74us (36005us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938823.068491:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 28 00000100:00100000:0.0:1784938823.069483:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342576512:192.168.202.104@tcp:13:osp-pre-0-0.0 00010000:00080000:0.0:1784938823.069508:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97460b0fea00 x1871643342575872/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938823.069520:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342575872:192.168.202.104@tcp:400:kworker.0 00010000:00080000:0.0:1784938823.069532:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97460b0ffb80 x1871643342576384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938823.069541:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342576384:192.168.202.104@tcp:400:kworker.0 00000100:00080000:0.0:1784938823.073813:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938823.074240:0:33798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974704026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:12802:x1871643342576000:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 25448us (41791us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938823.074258:0:33798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:3.0:1784938823.074426:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342576640:192.168.202.104@tcp:13:osp-pre-1-0.0 00010000:00080000:2.0:1784938823.079652:0:12802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97460b0fe300 x1871643342576000/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938823.079680:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342576000:192.168.202.104@tcp:400:kworker.0 00010000:00010000:1.0:1784938824.065258:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938825.075369:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938825.909094:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938825.909257:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326190080 00000100:00100000:1.0:1784938825.909272:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326190080 00000100:00100000:1.0:1784938825.909336:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:1.0:1784938825.909347:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:10022:x1871643326190080:12345-192.168.202.4@tcp:250:mount.lustre.0 00010000:00080000:1.0:1784938825.909386:0:33793:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from 8a440968-8bd3-4d99-86f9-70ce2c726340@192.168.202.4@tcp t0 exp 0000000000000000 cur 979 last 0 00000020:00000080:1.0:1784938825.909426:0:33793:0:(genops.c:1406:class_connect()) connect: client 8a440968-8bd3-4d99-86f9-70ce2c726340, cookie 0xcd9d312a94a09435 00000100:00080000:1.0:1784938825.909645:0:33793:0:(import.c:65:import_set_state_nolock()) ffff97471da1b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938825.909737:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a440968-8bd3-4d99-86f9-70ce2c726340+5:10022:x1871643326190080:12345-192.168.202.4@tcp:250:mount.lustre.0 Request processed in 390us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938825.909746:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:3.0:1784938825.913562:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938825.913693:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326190208 00000100:00100000:1.0:1784938825.913706:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326190208 00000100:00100000:1.0:1784938825.913813:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:1.0:1784938825.913825:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473669f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+5:25458:x1871643326190208:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784938825.913849:0:33794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938825.913876:0:33794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460290ba00/0xcd9d312a94a0943c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5fef expref: -99 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938825.913955:0:33794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460290ba00/0xcd9d312a94a0943c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fef expref: 6 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938825.913970:0:33794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460290ba00/0xcd9d312a94a0943c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fef expref: 6 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938825.913982:0:33794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290ba00, rc 0) 00000100:00100000:1.0:1784938825.914062:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473669f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+6:25458:x1871643326190208:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 239us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938825.914087:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:3.0:1784938825.922904:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938825.925140:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326190336 00000100:00100000:2.0:1784938825.925157:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326190336 00000100:00100000:2.0:1784938825.925229:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:2.0:1784938825.925241:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a440968-8bd3-4d99-86f9-70ce2c726340+6:25458:x1871643326190336:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784938825.925632:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a440968-8bd3-4d99-86f9-70ce2c726340+6:25458:x1871643326190336:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 391us (2748us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938825.925641:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:3.0:1784938825.928216:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938825.928266:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326190464 00000100:00100000:3.0:1784938825.928279:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326190464 00000100:00100000:3.0:1784938825.929113:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:3.0:1784938825.929124:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a440968-8bd3-4d99-86f9-70ce2c726340+6:25458:x1871643326190464:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784938825.929147:0:33793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938825.929172:0:33793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974742044200/0xcd9d312a94a09443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d5ff6 expref: -99 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938825.929211:0:33793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974742044200/0xcd9d312a94a09443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ff6 expref: 7 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938825.929224:0:33793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974742044200/0xcd9d312a94a09443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ff6 expref: 7 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938825.929256:0:33793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742044200, rc 0) 00000100:00100000:3.0:1784938825.929785:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a440968-8bd3-4d99-86f9-70ce2c726340+7:25458:x1871643326190464:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 659us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938825.929794:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:2.0:1784938825.940989:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938825.944139:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326190592 00000100:00100000:3.0:1784938825.944163:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326190592 00000100:00100000:3.0:1784938825.944252:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:3.0:1784938825.944265:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+7:25458:x1871643326190592:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784938825.945061:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+8:25458:x1871643326190592:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 788us (4075us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938825.945075:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:2.0:1784938825.953694:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938825.953913:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326190720 00000100:00100000:3.0:1784938825.953923:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326190720 00000100:00100000:3.0:1784938825.954050:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:3.0:1784938825.954060:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a440968-8bd3-4d99-86f9-70ce2c726340+8:25458:x1871643326190720:12345-192.168.202.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784938825.954798:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a440968-8bd3-4d99-86f9-70ce2c726340+8:25458:x1871643326190720:12345-192.168.202.4@tcp:503:mount.lustre.0 Request processed in 736us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938825.954809:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:2.0:1784938825.961570:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938825.961651:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326190848 00000100:00100000:3.0:1784938825.961661:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326190848 00000100:00100000:3.0:1784938825.961720:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:3.0:1784938825.961738:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+8:25470:x1871643326190848:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938825.962219:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+8:25470:x1871643326190848:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 481us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938825.962238:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:2.0:1784938826.011859:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938826.011966:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326190976 00000100:00100000:3.0:1784938826.011975:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326190976 00000100:00100000:3.0:1784938826.012037:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:3.0:1784938826.012053:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601e18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a440968-8bd3-4d99-86f9-70ce2c726340+8:25470:x1871643326190976:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938826.012357:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601e18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a440968-8bd3-4d99-86f9-70ce2c726340+8:25470:x1871643326190976:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 305us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938826.012367:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:3.0:1784938826.046140:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938826.046341:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326191104 00000100:00100000:2.0:1784938826.046351:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326191104 00000100:00100000:2.0:1784938826.046413:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:2.0:1784938826.046424:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974708e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a440968-8bd3-4d99-86f9-70ce2c726340+8:25458:x1871643326191104:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784938826.046442:0:33793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938826.046463:0:33793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974709893e00/0xcd9d312a94a0944a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d6020 expref: -99 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938826.046505:0:33793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974709893e00/0xcd9d312a94a0944a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6020 expref: 9 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938826.046527:0:33793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974709893e00/0xcd9d312a94a0944a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6020 expref: 9 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938826.046535:0:33793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893e00, rc 0) 00000100:00100000:2.0:1784938826.048193:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974708e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a440968-8bd3-4d99-86f9-70ce2c726340+9:25458:x1871643326191104:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 1761us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938826.048203:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:0.0:1784938826.059208:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938826.060614:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326191232 00000100:00100000:2.0:1784938826.060628:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326191232 00000100:00100000:2.0:1784938826.060700:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:2.0:1784938826.060710:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974708e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+9:25458:x1871643326191232:12345-192.168.202.4@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784938826.060787:0:33794:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784938826.060814:0:33794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784938826.060818:0:33794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784938826.060821:0:33794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784938826.060824:0:33794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1784938826.073157:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974708e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+9:25458:x1871643326191232:12345-192.168.202.4@tcp:256:mount.lustre.0 Request processed in 12436us (13947us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938826.073172:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:0.0:1784938826.079362:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938826.079512:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326191360 00000100:00100000:3.0:1784938826.079522:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326191360 00000100:00100000:3.0:1784938826.079585:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:3.0:1784938826.079595:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974708e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a440968-8bd3-4d99-86f9-70ce2c726340+9:25458:x1871643326191360:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784938826.079613:0:33795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938826.079634:0:33795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974742045c00/0xcd9d312a94a09451 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d6027 expref: -99 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938826.079664:0:33795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974742045c00/0xcd9d312a94a09451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6027 expref: 10 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938826.079678:0:33795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974742045c00/0xcd9d312a94a09451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6027 expref: 10 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938826.079688:0:33795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974742045c00, rc 0) 00000100:00100000:3.0:1784938826.079816:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974708e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a440968-8bd3-4d99-86f9-70ce2c726340+10:25458:x1871643326191360:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 222us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938826.079840:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:0.0:1784938826.087870:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938826.088284:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326191488 00000100:00100000:2.0:1784938826.088298:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326191488 00000100:00100000:2.0:1784938826.088380:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:2.0:1784938826.088393:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974708e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+10:25458:x1871643326191488:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784938826.089152:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974708e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+10:25458:x1871643326191488:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 754us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938826.089178:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00000400:3.0:1784938826.099149:0:12805:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938810/real 1784938810] req@ffff974603683800 x1871643342566912/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938826 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938826.099193:0:12805:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff974603683800 x1871643342566912/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938826 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938826.099221:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342566912:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938826.100208:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938826.100275:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326191616 00000100:00100000:1.0:1784938826.100287:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326191616 00000100:00100000:1.0:1784938826.100352:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:1.0:1784938826.100362:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974708e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a440968-8bd3-4d99-86f9-70ce2c726340+10:25458:x1871643326191616:12345-192.168.202.4@tcp:503:mount.lustre.0 00000100:00000400:2.0:1784938826.100972:0:12802:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938810/real 1784938810] req@ffff974603683b80 x1871643342567040/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938826 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938826.101000:0:12802:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff974603683b80 x1871643342567040/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938826 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938826.101021:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342567040:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938826.101648:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974708e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a440968-8bd3-4d99-86f9-70ce2c726340+10:25458:x1871643326191616:12345-192.168.202.4@tcp:503:mount.lustre.0 Request processed in 1285us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938826.101658:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 60 00010000:00010000:3.0:1784938826.101854:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938826.112408:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938826.112479:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326191744 00000100:00100000:0.0:1784938826.112493:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326191744 00000100:00100000:0.0:1784938826.112560:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:0.0:1784938826.112572:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974708e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a440968-8bd3-4d99-86f9-70ce2c726340+10:25473:x1871643326191744:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938826.113005:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974708e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a440968-8bd3-4d99-86f9-70ce2c726340+10:25473:x1871643326191744:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 433us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938826.113015:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:0.0:1784938826.125100:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938826.125494:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326191872 00000100:00100000:1.0:1784938826.125509:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326191872 00000100:00100000:1.0:1784938826.125584:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:1.0:1784938826.125596:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601397850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+10:25473:x1871643326191872:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784938826.126508:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601397850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+10:25473:x1871643326191872:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 909us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938826.126519:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:0.0:1784938826.140559:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938826.143177:0:33801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326192000 00000100:00100000:2.0:1784938826.143201:0:33801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326192000 00000100:00100000:2.0:1784938826.143285:0:33801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:2.0:1784938826.143297:0:33801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:10022:x1871643326192000:12345-192.168.202.4@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784938826.143340:0:33801:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from 8a20d661-ec21-417c-a7ab-df1444b7b9df@192.168.202.4@tcp t0 exp 0000000000000000 cur 979 last 0 00000020:00000080:2.0:1784938826.143414:0:33801:0:(genops.c:1406:class_connect()) connect: client 8a20d661-ec21-417c-a7ab-df1444b7b9df, cookie 0xcd9d312a94a09458 00000004:00100000:2.0:1784938826.143459:0:33801:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1784938826.143469:0:33801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1784938826.226139:0:33801:0:(import.c:65:import_set_state_nolock()) ffff97473c934800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938826.226248:0:33801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a20d661-ec21-417c-a7ab-df1444b7b9df+6:10022:x1871643326192000:12345-192.168.202.4@tcp:38:mount.lustre.0 Request processed in 82951us (85701us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938826.226262:0:33801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:0.0:1784938826.230200:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938826.230248:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938826.230341:0:33798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326192256 00000100:00100000:3.0:1784938826.230353:0:33798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326192256 00000100:00100000:3.0:1784938826.230428:0:33798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326192128 00000100:00100000:3.0:1784938826.230431:0:33798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326192128 00000100:00100000:3.0:1784938826.230457:0:33798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:3.0:1784938826.230467:0:33798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+7:25458:x1871643326192256:12345-192.168.202.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784938826.230524:0:33798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 390463488 avail 388366336 00000100:00100000:3.0:1784938826.230615:0:33798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+7:25458:x1871643326192256:12345-192.168.202.4@tcp:41:mount.lustre.0 Request processed in 149us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938826.230623:0:33798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:3.0:1784938826.230639:0:33798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:3.0:1784938826.230646:0:33798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+6:0:x1871643326192128:12345-192.168.202.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784938826.230655:0:33798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 390463488 avail 388366336 00000100:00100000:3.0:1784938826.230671:0:33798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+6:0:x1871643326192128:12345-192.168.202.4@tcp:41:mount.lustre.0 Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938826.230677:0:33798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00080000:0.0:1784938826.230735:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938826.234712:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938826.235426:0:33798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326192384 00000100:00100000:3.0:1784938826.235458:0:33798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326192384 00000100:00100000:3.0:1784938826.236172:0:33798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:3.0:1784938826.236186:0:33798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+6:25458:x1871643326192384:12345-192.168.202.4@tcp:40:mount.lustre.0 00000100:00100000:3.0:1784938826.236312:0:33798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+6:25458:x1871643326192384:12345-192.168.202.4@tcp:40:mount.lustre.0 Request processed in 129us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938826.236321:0:33798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:2.0:1784938826.252934:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938826.252998:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938826.253047:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938826.255316:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326192512 00000100:00100000:1.0:1784938826.255336:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326192512 00000100:00100000:1.0:1784938826.255411:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326192640 00000100:00100000:1.0:1784938826.255415:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326192640 00000100:00100000:1.0:1784938826.255443:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 180 00000100:00100000:1.0:1784938826.255453:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:10022:x1871643326192512:12345-192.168.202.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784938826.255499:0:31427:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from 8a20d661-ec21-417c-a7ab-df1444b7b9df@192.168.202.4@tcp t0 exp 0000000000000000 cur 980 last 0 00000020:00000080:1.0:1784938826.255546:0:31427:0:(genops.c:1406:class_connect()) connect: client 8a20d661-ec21-417c-a7ab-df1444b7b9df, cookie 0xcd9d312a94a0945f 00002000:00100000:1.0:1784938826.255563:0:31427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8a20d661-ec21-417c-a7ab-df1444b7b9df/ffff97471da1f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784938826.255620:0:31427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938826.256026:0:31427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784938826.256069:0:31427:0:(import.c:65:import_set_state_nolock()) ffff97471da1c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938826.256165:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a20d661-ec21-417c-a7ab-df1444b7b9df+6:10022:x1871643326192512:12345-192.168.202.4@tcp:8:mount.lustre.0 Request processed in 710us (3164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938826.256174:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 180 00000100:00100000:1.0:1784938826.256199:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 181 00000100:00100000:1.0:1784938826.256204:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:10022:x1871643326192640:12345-192.168.202.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784938826.256220:0:31427:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from 8a20d661-ec21-417c-a7ab-df1444b7b9df@192.168.202.4@tcp t0 exp 0000000000000000 cur 980 last 0 00000020:00000080:1.0:1784938826.256238:0:31427:0:(genops.c:1406:class_connect()) connect: client 8a20d661-ec21-417c-a7ab-df1444b7b9df, cookie 0xcd9d312a94a09466 00002000:00100000:1.0:1784938826.256244:0:31427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8a20d661-ec21-417c-a7ab-df1444b7b9df/ffff97471da19000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784938826.256262:0:31427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938826.256387:0:31427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784938826.256400:0:31427:0:(import.c:65:import_set_state_nolock()) ffff97471da1c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938826.256423:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a20d661-ec21-417c-a7ab-df1444b7b9df+6:10022:x1871643326192640:12345-192.168.202.4@tcp:8:mount.lustre.0 Request processed in 218us (3376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938826.256429:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 181 00000100:00100000:3.0:1784938826.257573:0:33802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326192768 00000100:00100000:3.0:1784938826.257584:0:33802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326192768 00000100:00100000:3.0:1784938826.257643:0:33802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:3.0:1784938826.257652:0:33802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+6:25458:x1871643326192768:12345-192.168.202.4@tcp:33:mount.lustre.0 00000004:00080000:3.0:1784938826.260275:0:33802:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2542us 00000004:00200000:3.0:1784938826.294314:0:33802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1784938826.294531:0:33802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+6:25458:x1871643326192768:12345-192.168.202.4@tcp:33:mount.lustre.0 Request processed in 36871us (41605us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938826.294543:0:33802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00010000:00010000:1.0:1784938827.125399:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938828.146899:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938828.147089:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342576768:0@lo:400:kworker.0 00000100:00100000:3.0:1784938828.147164:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938828.147208:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342577280:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938828.147265:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938828.147272:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342577152:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938828.147318:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342577024:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938828.147346:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784938828.147352:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:12803:1871643342576896:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938828.147370:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:12803:1871643342577408:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938828.147642:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938828.147652:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460b0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342577536:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938828.147703:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342576768 00000100:00100000:2.0:1784938828.147711:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342576768 00000100:00100000:2.0:1784938828.147777:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784938828.147786:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601395050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12805:x1871643342576768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938828.147836:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601395050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12805:x1871643342576768:12345-0@lo:400:kworker.0 Request processed in 51us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938828.147843:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784938828.148038:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938828.148099:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938828.148120:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938828.148138:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938828.148157:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938828.148181:0:34170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342576896 00000100:00100000:2.0:1784938828.148185:0:34170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342576896 00000100:00100000:2.0:1784938828.148217:0:34170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342577024 00000100:00100000:2.0:1784938828.148220:0:34170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342577024 00000100:00100000:2.0:1784938828.148241:0:34170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00100000:2.0:1784938828.148248:0:34170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:12803:x1871643342576896:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938828.148284:0:34170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:12803:x1871643342576896:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 36us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938828.148291:0:34170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00100000:2.0:1784938828.148304:0:34170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00100000:2.0:1784938828.148311:0:34170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342577024:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938828.148333:0:34170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:12803:x1871643342577024:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 23us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938828.148340:0:34170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00100000:2.0:1784938828.148373:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342577152 00000100:00100000:2.0:1784938828.148507:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342577152 00000100:00100000:2.0:1784938828.148540:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342577280 00000100:00100000:2.0:1784938828.148543:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342577280 00000100:00100000:2.0:1784938828.148564:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 23 00000100:00100000:2.0:1784938828.148571:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342577152:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938828.148599:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342577152:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 28us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938828.148605:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 23 00000100:00100000:2.0:1784938828.148616:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 24 00000100:00100000:2.0:1784938828.148622:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342577280:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938828.148644:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342577280:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938828.148650:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 24 00000100:00100000:2.0:1784938828.148670:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342577536 00000100:00100000:2.0:1784938828.148674:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342577536 00000100:00100000:2.0:1784938828.148693:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 29 00000100:00100000:2.0:1784938828.148699:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342577536:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938828.148713:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 384827392 avail 382730240 00000100:00100000:2.0:1784938828.148736:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342577536:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 37us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938828.148743:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 29 00000100:00080000:2.0:1784938828.148779:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938828.148783:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938828.148786:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938828.148970:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460b0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342577536:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938828.149039:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342577152:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938828.149049:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342576768:0@lo:400:kworker.0 00000100:00100000:2.0:1784938828.149057:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342577280:192.168.202.104@tcp:400:kworker.0 00010000:00080000:3.0:1784938828.149482:0:12803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974602fb4700 x1871643342577024/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938828.149494:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:12803:1871643342577024:192.168.202.104@tcp:400:kworker.0 00010000:00080000:3.0:1784938828.149511:0:12803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974602fb4e00 x1871643342576896/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938828.149521:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:12803:1871643342576896:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938828.150641:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342577664:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938828.151847:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938828.151887:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938828.151911:0:34170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342577408 00000100:00100000:2.0:1784938828.151918:0:34170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342577408 00000100:00100000:2.0:1784938828.152195:0:34170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:2.0:1784938828.152205:0:34170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:12803:x1871643342577408:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938828.152264:0:34170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:12803:x1871643342577408:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 61us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938828.152271:0:34170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:2.0:1784938828.152296:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342577664 00000100:00100000:2.0:1784938828.152302:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342577664 00000100:00100000:2.0:1784938828.152328:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 30 00000100:00100000:2.0:1784938828.152334:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342577664:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938828.152351:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 386924544 avail 384827392 00000100:00100000:2.0:1784938828.152506:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342577664:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 42us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938828.152514:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 30 00010000:00080000:2.0:1784938828.152670:0:12803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974602fb5f80 x1871643342577408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938828.152684:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:12803:1871643342577408:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938828.168993:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342577664:192.168.202.104@tcp:13:osp-pre-0-0.0 00010000:00010000:0.0:1784938829.175831:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784938829.279993:0:31424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8a20d661-ec21-417c-a7ab-df1444b7b9df 00000100:00100000:2.0:1784938829.635678:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938829.635787:0:33801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326192896 00000100:00100000:3.0:1784938829.635798:0:33801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326192896 00000100:00100000:3.0:1784938829.635882:0:33801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:3.0:1784938829.635897:0:33801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a20d661-ec21-417c-a7ab-df1444b7b9df+6:25586:x1871643326192896:12345-192.168.202.4@tcp:101:diff.0 00010000:00010000:3.0:1784938829.635919:0:33801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1784938829.636048:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784938829.636230:0:33801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a0946d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d6051 expref: -99 pid: 33801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.636309:0:33801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a09474 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.636325:0:33801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a09474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.636341:0:33801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a09474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938829.636620:0:33801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784938829.636625:0:33801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938829.636731:0:33801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a09474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.636794:0:33801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a0946d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6051 expref: 8 pid: 33801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.636813:0:33801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a09474 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6051 expref: 7 pid: 33801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.636821:0:33801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974609f5d100) 00010000:00010000:2.0:1784938829.636824:0:33801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938829.636827:0:33801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893c00, rc 0) 00000100:00100000:2.0:1784938829.636910:0:33801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a20d661-ec21-417c-a7ab-df1444b7b9df+7:25586:x1871643326192896:12345-192.168.202.4@tcp:101:diff.0 Request processed in 1018us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938829.636918:0:33801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:2.0:1784938829.640278:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938829.641049:0:34170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326193024 00000100:00100000:3.0:1784938829.641063:0:34170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326193024 00000100:00100000:3.0:1784938829.641126:0:34170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:3.0:1784938829.641136:0:34170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a20d661-ec21-417c-a7ab-df1444b7b9df+7:25586:x1871643326193024:12345-192.168.202.4@tcp:101:diff.0 00010000:00010000:3.0:1784938829.641160:0:34170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938829.641185:0:34170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a0947b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d6058 expref: -99 pid: 34170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938829.641256:0:34170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a09482 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938829.641271:0:34170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a09482 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938829.641304:0:34170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a09482 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938829.641322:0:34170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a09489 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938829.641329:0:34170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a09489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938829.641335:0:34170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a09489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672169:0:34170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a09490 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672193:0:34170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a09490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672206:0:34170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a09490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938829.672372:0:34170:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784938829.672377:0:34170:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938829.672459:0:34170:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a09490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672476:0:34170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a09482 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672483:0:34170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a09482 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672490:0:34170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a09482 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672496:0:34170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a600 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938829.672500:0:34170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a09482 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672509:0:34170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a09482 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672530:0:34170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974609f5d100) 00010000:00010000:2.0:1784938829.672533:0:34170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938829.672538:0:34170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a09482 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672545:0:34170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a600/0xcd9d312a94a09482 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672559:0:34170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a09489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672566:0:34170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a09489 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672571:0:34170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a09489 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672577:0:34170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209aa00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:2.0:1784938829.672580:0:34170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a09489 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672586:0:34170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a09489 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672594:0:34170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc82c34f8 (ffff9747214ca500) 00010000:00010000:2.0:1784938829.672596:0:34170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938829.672599:0:34170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a09489 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672605:0:34170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209aa00/0xcd9d312a94a09489 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc82c34f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34170 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672661:0:34170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209be00/0xcd9d312a94a0947b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6058 expref: 9 pid: 34170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672677:0:34170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a09490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6058 expref: 8 pid: 34170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.672685:0:34170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974609f5dc00) 00010000:00010000:2.0:1784938829.672688:0:34170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938829.672690:0:34170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893a00, rc 0) 00000100:00100000:2.0:1784938829.672786:0:34170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a20d661-ec21-417c-a7ab-df1444b7b9df+8:25586:x1871643326193024:12345-192.168.202.4@tcp:101:diff.0 Request processed in 31649us (32515us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938829.672797:0:34170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:3.0:1784938829.678654:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938829.678738:0:33798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326193152 00000100:00100000:1.0:1784938829.678747:0:33798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326193152 00000100:00100000:1.0:1784938829.678826:0:33798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:1.0:1784938829.678836:0:33798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+8:25586:x1871643326193152:12345-192.168.202.4@tcp:101:diff.0 00010000:00010000:1.0:1784938829.678870:0:33798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938829.678903:0:33798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a09497 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d605f expref: -99 pid: 33798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.678973:0:33798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a0949e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.678989:0:33798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a0949e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.679001:0:33798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a0949e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.679017:0:33798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a094a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.679024:0:33798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a094a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.679030:0:33798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a094a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690400:0:33798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a094ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690423:0:33798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a094ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690436:0:33798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a094ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938829.690481:0:33798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 29184 00000004:00200000:1.0:1784938829.690486:0:33798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 178 stripe count 1 MDT count 1 00000004:00010000:1.0:1784938829.690517:0:33798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a094ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690545:0:33798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a0949e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690552:0:33798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a0949e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690558:0:33798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a0949e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690563:0:33798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290ae00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938829.690567:0:33798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a0949e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690574:0:33798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a0949e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690587:0:33798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974609f5dc00) 00010000:00010000:1.0:1784938829.690589:0:33798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938829.690595:0:33798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a0949e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690600:0:33798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290ae00/0xcd9d312a94a0949e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690611:0:33798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a094a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690617:0:33798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a094a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690623:0:33798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a094a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690635:0:33798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290bc00 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938829.690651:0:33798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a094a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690657:0:33798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a094a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690666:0:33798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa1c75412 (ffff974702d24c00) 00010000:00010000:1.0:1784938829.690668:0:33798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938829.690671:0:33798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a094a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690677:0:33798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290bc00/0xcd9d312a94a094a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa1c75412 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690725:0:33798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a09497 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d605f expref: 10 pid: 33798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690740:0:33798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a094ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d605f expref: 9 pid: 33798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.690748:0:33798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974702d24700) 00010000:00010000:1.0:1784938829.690769:0:33798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938829.690771:0:33798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290a400, rc 0) 00000100:00100000:1.0:1784938829.690914:0:33798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+9:25586:x1871643326193152:12345-192.168.202.4@tcp:101:diff.0 Request processed in 12077us (12280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938829.690933:0:33798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:3.0:1784938829.704277:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938829.707359:0:33800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326193280 00000100:00100000:2.0:1784938829.707376:0:33800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326193280 00000100:00100000:2.0:1784938829.707464:0:33800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:2.0:1784938829.707474:0:33800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a20d661-ec21-417c-a7ab-df1444b7b9df+9:25586:x1871643326193280:12345-192.168.202.4@tcp:101:diff.0 00010000:00010000:2.0:1784938829.707496:0:33800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938829.707517:0:33800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a094b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d6066 expref: -99 pid: 33800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.707584:0:33800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a094ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.707599:0:33800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a094ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.707611:0:33800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a094ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.707637:0:33800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a094c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.707646:0:33800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a094c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938829.707652:0:33800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a094c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00100000:10000000:2.0:1784938829.734054:0:34349:0:(scrub.c:294:scrub_thread_prep()) lustre-MDT0000: OI scrub prep, flags = 0x4a 00100000:10000000:2.0:1784938829.734275:0:34349:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1784938829.734297:0:34349:0:(osd_scrub.c:514:osd_scrub_main()) lustre-MDT0000: OI scrub start, flags = 0x4a, pos = 1 00100000:02000000:2.0:1784938829.734539:0:34349:0:(osd_scrub.c:337:osd_scrub_next()) *** cfs_fail_loc=190, val=3*** 00080000:12000400:0.0:1784938829.735995:0:33800:0:(osd_index.c:603:osd_zfs_consistency_check()) lustre-MDT0000: trigger partial OI scrub for RPC inconsistency, checking FID [0x200000401:0x4e:0x0]/0x252): rc = 0 00010000:00010000:1.0:1784938829.754892:0:33800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a094c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.754990:0:33800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a094c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.755005:0:33800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a094c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938829.755040:0:33800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 316748 00000004:00200000:1.0:1784938829.755045:0:33800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784938829.755066:0:33800:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a094c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.755079:0:33800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a094c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.755089:0:33800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a094ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.755096:0:33800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a094ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.755103:0:33800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a094ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.755108:0:33800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893800 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938829.755112:0:33800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a094ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.756567:0:33800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a094ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.756594:0:33800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974702d24700) 00010000:00010000:1.0:1784938829.756608:0:33800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938829.756615:0:33800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a094ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.756622:0:33800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893800/0xcd9d312a94a094ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.756639:0:33800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a094c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.756645:0:33800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a094c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.756652:0:33800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a094c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.756658:0:33800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893200 already unused, calling callback (ffffffffc1e724f0) 00010000:00010000:1.0:1784938829.756661:0:33800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a094c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.756668:0:33800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a094c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.756675:0:33800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x6caa4986 (ffff974609f5de00) 00010000:00010000:1.0:1784938829.756678:0:33800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938829.756680:0:33800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a094c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.756686:0:33800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893200/0xcd9d312a94a094c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x6caa4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 33800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.756737:0:33800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709892600/0xcd9d312a94a094b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6066 expref: 11 pid: 33800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.756783:0:33800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a094c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6066 expref: 10 pid: 33800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.756791:0:33800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff974702d24c00) 00010000:00010000:1.0:1784938829.756794:0:33800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938829.756796:0:33800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290be00, rc 0) 00000100:00100000:1.0:1784938829.757232:0:33800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a20d661-ec21-417c-a7ab-df1444b7b9df+10:25586:x1871643326193280:12345-192.168.202.4@tcp:101:diff.0 Request processed in 49757us (52963us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938829.757242:0:33800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00080000:00020000:2.0:1784938829.757978:0:34349:0:(osd_index.c:203:__osd_xattr_load_by_oid()) lustre-MDT0000: can't get bonus, rc = -17 00100000:10000000:2.0:1784938829.765701:0:34349:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 2, force no, [0x200000401:0x4e:0x0] => 594 (null): rc = 0 00100000:02000000:2.0:1784938829.765715:0:34349:0:(osd_scrub.c:337:osd_scrub_next()) *** cfs_fail_loc=190, val=3*** 00000100:00100000:1.0:1784938829.774130:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938829.775286:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326193408 00000100:00100000:3.0:1784938829.775302:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326193408 00000100:00080000:3.0:1784938829.776793:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938829.778820:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 182 00000100:00100000:3.0:1784938829.778841:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+6:10026:x1871643326193408:12345-192.168.202.4@tcp:101:diff.0 00010000:00010000:3.0:1784938829.779048:0:31425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938829.779074:0:31425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b96a6e1/0xcd9d312a94a094cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d606d expref: -99 pid: 31425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938829.779104:0:31425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 316748, mtime: 0x6a640123, atime: 0x0, ctime: 0x6a640125, blocks: 0x403 00010000:00010000:3.0:1784938829.779519:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=983s v=(0 0) 00010000:00010000:3.0:1784938829.779524:0:31425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938829.779536:0:31425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b96a6e1/0xcd9d312a94a094cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d606d expref: 7 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938829.779584:0:31425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b96a6e1/0xcd9d312a94a094cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d606d expref: 7 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938829.779597:0:31425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209ac00, rc 0) 00000100:00100000:3.0:1784938829.779668:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+7:10026:x1871643326193408:12345-192.168.202.4@tcp:101:diff.0 Request processed in 837us (5557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938829.779676:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 182 00000100:00100000:2.0:1784938829.800486:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938829.800586:0:33801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326193664 00000100:00100000:3.0:1784938829.800599:0:33801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326193664 00000100:00100000:3.0:1784938829.800677:0:33801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:3.0:1784938829.800689:0:33801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a20d661-ec21-417c-a7ab-df1444b7b9df+10:25586:x1871643326193664:12345-192.168.202.4@tcp:101:diff.0 00010000:00010000:3.0:1784938829.800711:0:33801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938829.800735:0:33801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a200/0xcd9d312a94a094d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x41eed6a02c9d6074 expref: -99 pid: 33801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938829.800900:0:33801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209bc00/0xcd9d312a94a094dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 33801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938829.800915:0:33801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97460209bc00/0xcd9d312a94a094dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 33801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938829.800926:0:33801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97460209bc00/0xcd9d312a94a094dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 33801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938829.800937:0:33801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 316748 00010000:00010000:3.0:1784938829.802634:0:33801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209a200/0xcd9d312a94a094d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6074 expref: 13 pid: 33801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938829.802673:0:33801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97460209bc00/0xcd9d312a94a094dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6074 expref: 12 pid: 33801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938829.802684:0:33801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff974702d24c00) 00010000:00010000:3.0:1784938829.802687:0:33801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938829.802690:0:33801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209bc00, rc 0) 00000100:00100000:3.0:1784938829.802791:0:33801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a20d661-ec21-417c-a7ab-df1444b7b9df+12:25586:x1871643326193664:12345-192.168.202.4@tcp:101:diff.0 Request processed in 2104us (2319us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1784938829.802800:0:33801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:1.0:1784938829.818850:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938829.822516:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326193792 00000100:00100000:3.0:1784938829.822533:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326193792 00000100:00100000:0.0:1784938829.823938:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938829.823968:0:33171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326193920 00000100:00100000:2.0:1784938829.823977:0:33171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326193920 00002000:00100000:2.0:1784938829.824028:0:33171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x27:0x0] (0->319487) req@ffff974608ff8e00 x1871643326193920/t0(0) o3->8a20d661-ec21-417c-a7ab-df1444b7b9df@192.168.202.4@tcp:305/0 lens 488/0 e 0 to 0 dl 1784938840 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938829.824039:0:33171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974608ff8e00 with x1871643326193920 ext(0->319487) 00002000:00010000:2.0:1784938829.824045:0:33171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974608ff8e00 00000100:00100000:2.0:1784938829.824078:0:33171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:2.0:1784938829.824089:0:33171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8a20d661-ec21-417c-a7ab-df1444b7b9df+7:10024:x1871643326193920:12345-192.168.202.4@tcp:3:diff.0 00000100:00100000:1.0:1784938829.829774:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:1.0:1784938829.829797:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+12:10024:x1871643326193792:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938829.829819:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938829.829852:0:30615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460209bc00/0xcd9d312a94a094dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6074 expref: 12 pid: 33801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938829.829883:0:30615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff974702d24c00) 00010000:00010000:1.0:1784938829.829889:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938829.829965:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+11:10024:x1871643326193792:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 175us (11124us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938829.829974:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:2.0:1784938829.855493:0:33171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8a20d661-ec21-417c-a7ab-df1444b7b9df+7:10024:x1871643326193920:12345-192.168.202.4@tcp:3:diff.0 Request processed in 31394us (31561us total) trans 0 rc 319488/319488 00000100:00100000:2.0:1784938829.855525:0:33171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 79 00002000:00100000:2.0:1784938829.855541:0:33171:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x27:0x0] (0->319487) req@ffff974608ff8e00 x1871643326193920/t0(0) o3->8a20d661-ec21-417c-a7ab-df1444b7b9df@192.168.202.4@tcp:305/0 lens 488/440 e 0 to 0 dl 1784938840 ref 1 fl Complete:/600/0 rc 319488/319488 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938829.855550:0:33171:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974608ff8e00 with x1871643326193920 ext(0->319487) 00002000:00010000:2.0:1784938829.855557:0:33171:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974608ff8e00 00000100:00100000:1.0:1784938829.864820:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938829.865988:0:33803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326194176 00000100:00100000:3.0:1784938829.866007:0:33803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326194176 00000100:00100000:3.0:1784938829.866114:0:33803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:3.0:1784938829.866128:0:33803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a20d661-ec21-417c-a7ab-df1444b7b9df+11:25586:x1871643326194176:12345-192.168.202.4@tcp:35:diff.0 00000001:00080000:3.0:1784938829.867044:0:33803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934594 00000100:00100000:2.0:1784938829.868082:0:33803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a20d661-ec21-417c-a7ab-df1444b7b9df+13:25586:x1871643326194176:12345-192.168.202.4@tcp:35:diff.0 Request processed in 1945us (3263us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1784938829.868105:0:33803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00000020:00080000:2.0:1784938829.868114:0:33803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784938830.198196:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938831.220368:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938831.324211:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938831.324250:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1784938831.324275:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326194304 00000100:00100000:3.0:1784938831.324284:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326194304 00000100:00100000:3.0:1784938831.324340:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326194432 00000100:00100000:3.0:1784938831.324343:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326194432 00000100:00100000:3.0:1784938831.324370:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:3.0:1784938831.324378:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a440968-8bd3-4d99-86f9-70ce2c726340+11:10025:x1871643326194304:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938831.324393:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938831.324427:0:30615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974742044200/0xcd9d312a94a09443 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5ff6 expref: 11 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938831.324447:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938831.324517:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a440968-8bd3-4d99-86f9-70ce2c726340+10:10025:x1871643326194304:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 138us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938831.324526:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:3.0:1784938831.324555:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:3.0:1784938831.324562:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a440968-8bd3-4d99-86f9-70ce2c726340+9:10026:x1871643326194432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938831.324570:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938831.324579:0:30615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974709893e00/0xcd9d312a94a0944a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6020 expref: 9 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938831.324639:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938831.324657:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a440968-8bd3-4d99-86f9-70ce2c726340+8:10026:x1871643326194432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 97us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938831.324663:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:3.0:1784938831.325436:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938831.328672:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326194688 00000100:00100000:2.0:1784938831.328690:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326194688 00000100:00100000:2.0:1784938831.328811:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 183 00000100:00100000:2.0:1784938831.328823:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a20d661-ec21-417c-a7ab-df1444b7b9df+7:10022:x1871643326194688:12345-192.168.202.4@tcp:9:umount.0 00000020:00000080:2.0:1784938831.328869:0:33065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a09466 00000020:00010000:2.0:1784938831.328877:0:33065:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97471da19000: total 0 00000100:00080000:2.0:1784938831.328881:0:33065:0:(import.c:65:import_set_state_nolock()) ffff97471da1c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784938831.328924:0:33065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967350 00000100:00100000:2.0:1784938831.329298:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a20d661-ec21-417c-a7ab-df1444b7b9df+5:10022:x1871643326194688:12345-192.168.202.4@tcp:9:umount.0 Request processed in 476us (3864us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938831.329308:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 183 00000100:00080000:2.0:1784938831.329329:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:2.0:1784938831.329340:0:31441:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97471da19000: total 0 00010000:00010000:2.0:1784938831.329359:0:31441:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97471da19000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784938831.329412:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b96a6e1/0xcd9d312a94a094cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d606d expref: 4 pid: 31425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938831.329455:0:31441:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97471da19000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1784938831.329467:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938831.329469:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938831.329471:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938831.336647:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938831.336781:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1784938831.336825:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326194816 00000100:00100000:2.0:1784938831.336835:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326194816 00000100:00100000:2.0:1784938831.336909:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:2.0:1784938831.336919:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a440968-8bd3-4d99-86f9-70ce2c726340+8:10024:x1871643326194816:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938831.336936:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938831.336956:0:30615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974742045c00/0xcd9d312a94a09451 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6027 expref: 8 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938831.336973:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938831.337030:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a440968-8bd3-4d99-86f9-70ce2c726340+7:10024:x1871643326194816:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 113us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938831.337038:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:2.0:1784938831.337062:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326194944 00000100:00100000:2.0:1784938831.337065:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326194944 00000100:00100000:2.0:1784938831.337102:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 184 00000100:00100000:2.0:1784938831.337108:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+5:10022:x1871643326194944:12345-192.168.202.4@tcp:9:umount.0 00000020:00000080:2.0:1784938831.337135:0:31425:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a0945f 00000100:00080000:2.0:1784938831.337147:0:31425:0:(import.c:65:import_set_state_nolock()) ffff97471da1c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784938831.337205:0:31425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967350 00000100:00100000:2.0:1784938831.337537:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a20d661-ec21-417c-a7ab-df1444b7b9df+2:10022:x1871643326194944:12345-192.168.202.4@tcp:9:umount.0 Request processed in 427us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938831.337558:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 184 00000100:00080000:2.0:1784938831.337678:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784938831.337689:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784938831.338710:0:33806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8a20d661-ec21-417c-a7ab-df1444b7b9df 00000001:00080000:2.0:1784938831.338726:0:33806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000100:00100000:3.0:1784938831.356327:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1784938831.356492:0:34170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326195584 00000100:00100000:0.0:1784938831.356503:0:34170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326195584 00000100:00100000:0.0:1784938831.356594:0:34170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:0.0:1784938831.356606:0:34170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a20d661-ec21-417c-a7ab-df1444b7b9df+9:10022:x1871643326195584:12345-192.168.202.4@tcp:39:umount.0 00000020:00000080:0.0:1784938831.356651:0:34170:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a09458 00000020:00010000:0.0:1784938831.356660:0:34170:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97473c937000: total 0 00000100:00080000:0.0:1784938831.356665:0:34170:0:(import.c:65:import_set_state_nolock()) ffff97473c934800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938831.356688:0:34170:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934595 00000100:00100000:0.0:1784938831.357134:0:34170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a20d661-ec21-417c-a7ab-df1444b7b9df+8:10022:x1871643326195584:12345-192.168.202.4@tcp:39:umount.0 Request processed in 529us (816us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1784938831.357143:0:34170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000020:00010000:0.0:1784938831.357288:0:30618:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97473c937000: total 0 00010000:00010000:0.0:1784938831.357293:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938831.357333:0:30618:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97473c937000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1784938831.357370:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974702d24700) 00010000:00010000:0.0:1784938831.357373:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938831.357381:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290a400/0xcd9d312a94a094ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d605f expref: 7 pid: 33798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938831.357407:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974609f5dc00) 00010000:00010000:0.0:1784938831.357410:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938831.357430:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893a00/0xcd9d312a94a09490 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6058 expref: 6 pid: 34170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938831.357450:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff974702d24c00) 00010000:00010000:0.0:1784938831.357452:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938831.357456:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97460290be00/0xcd9d312a94a094c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6066 expref: 5 pid: 33800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938831.357470:0:30618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974609f5d100) 00010000:00010000:0.0:1784938831.357472:0:30618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938831.357475:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974709893c00/0xcd9d312a94a09474 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d6051 expref: 4 pid: 33801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938831.357488:0:30618:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97473c937000, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1784938831.357504:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938831.357506:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938831.357508:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938831.357943:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1784938831.358669:0:32270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8a20d661-ec21-417c-a7ab-df1444b7b9df 00000100:00100000:2.0:1784938831.373617:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1784938831.374638:0:33794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643326195840 00000100:00100000:1.0:1784938831.374666:0:33794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643326195840 00000100:00100000:1.0:1784938831.374734:0:33794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:1.0:1784938831.374745:0:33794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+7:10022:x1871643326195840:12345-192.168.202.4@tcp:251:umount.0 00000020:00000080:1.0:1784938831.374834:0:33794:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a09435 00000020:00010000:1.0:1784938831.374852:0:33794:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97471da1e800: total 0 00000100:00080000:1.0:1784938831.374858:0:33794:0:(import.c:65:import_set_state_nolock()) ffff97471da1b000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784938831.374952:0:33794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a440968-8bd3-4d99-86f9-70ce2c726340+3:10022:x1871643326195840:12345-192.168.202.4@tcp:251:umount.0 Request processed in 208us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938831.374960:0:33794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 64 00000020:00010000:0.0:1784938831.376624:0:31441:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97471da1e800: total 0 00010000:00010000:0.0:1784938831.376686:0:31441:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97471da1e800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784938831.376724:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460290ba00/0xcd9d312a94a0943c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x41eed6a02c9d5fef expref: 2 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938831.376741:0:31441:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97471da1e800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1784938831.376812:0:31441:0:(genops.c:906:class_export_put()) final put ffff97471da1e800/8a440968-8bd3-4d99-86f9-70ce2c726340 00010000:00010000:0.0:1784938831.376827:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938831.376830:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938831.376832:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784938831.377055:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff97471da1e800/8a440968-8bd3-4d99-86f9-70ce2c726340 for MGS 00000020:00000080:3.0:1784938831.377101:0:24411:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97471da1b000 for MGS 00010000:00010000:2.0:1784938832.242925:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:02000000:2.0:1784938832.820012:0:34349:0:(osd_scrub.c:337:osd_scrub_next()) *** cfs_fail_loc=190, val=3*** 00000100:00100000:2.0:1784938833.267317:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342577792:0@lo:400:kworker.0 00000100:00100000:2.0:1784938833.267396:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938833.267442:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460134ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342578304:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938833.267502:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938833.267509:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460134c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342578176:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938833.267550:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460134e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342577920:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938833.267576:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460134f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342578432:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938833.267596:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784938833.267602:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460134c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342578048:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938833.267648:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460134c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342578560:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938833.267687:0:33795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342577792 00000100:00100000:2.0:1784938833.267696:0:33795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342577792 00000100:00100000:2.0:1784938833.267777:0:33795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784938833.267786:0:33795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12805:x1871643342577792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938833.267857:0:33795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12805:x1871643342577792:12345-0@lo:400:kworker.0 Request processed in 71us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938833.267873:0:33795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784938833.268019:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342578688:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938833.268372:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938833.268424:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938833.268443:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938833.268458:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938833.268479:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938833.268496:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938833.268538:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938833.268573:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342577792:0@lo:400:kworker.0 00000100:00100000:2.0:1784938833.268606:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342578176 00000100:00100000:2.0:1784938833.268610:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342578176 00000100:00100000:2.0:1784938833.268648:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342578304 00000100:00100000:2.0:1784938833.268651:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342578304 00000100:00100000:2.0:1784938833.268671:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 25 00000100:00100000:2.0:1784938833.268678:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342578176:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938833.268715:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342578176:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 36us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938833.268721:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 25 00000100:00100000:2.0:1784938833.268735:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 26 00000100:00100000:2.0:1784938833.268741:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460b0fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342578304:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938833.268791:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460b0fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342578304:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 49us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938833.268796:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 26 00000100:00100000:2.0:1784938833.268815:0:33798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342578432 00000100:00100000:2.0:1784938833.268819:0:33798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342578432 00000100:00100000:2.0:1784938833.268861:0:33798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342577920 00000100:00100000:2.0:1784938833.268865:0:33798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342577920 00000100:00100000:2.0:1784938833.268878:0:33798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342578048 00000100:00100000:2.0:1784938833.268880:0:33798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342578048 00000100:00100000:3.0:1784938833.270358:0:33801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 6 00000100:00100000:3.0:1784938833.270372:0:33801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342578432:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938833.270434:0:33801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12802:x1871643342578432:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 67us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938833.270454:0:33801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 6 00000100:00100000:3.0:1784938833.270474:0:33801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 7 00000100:00100000:3.0:1784938833.270481:0:33801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342577920:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938833.270508:0:33801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12802:x1871643342577920:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 28us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938833.270514:0:33801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 7 00000100:00100000:3.0:1784938833.270524:0:33801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 8 00000100:00100000:3.0:1784938833.270530:0:33801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12802:x1871643342578048:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938833.270549:0:33801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12802:x1871643342578048:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 19us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938833.270555:0:33801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 8 00000100:00100000:3.0:1784938833.270602:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460134c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342578176:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938833.270615:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460134ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342578304:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938833.270767:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460134c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342578048:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938833.270783:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460134e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342577920:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938833.270796:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460134f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:12802:1871643342578432:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938833.271179:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342578560 00000100:00100000:2.0:1784938833.271187:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342578560 00000100:00100000:2.0:1784938833.271213:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342578688 00000100:00100000:2.0:1784938833.271216:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342578688 00000100:00100000:2.0:1784938833.271229:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 31 00000100:00100000:2.0:1784938833.271236:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342578560:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938833.271271:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 384827392 avail 382730240 00000100:00100000:2.0:1784938833.271325:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342578560:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 88us (2844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938833.271332:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 31 00000100:00100000:2.0:1784938833.271345:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 32 00000100:00100000:2.0:1784938833.271352:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342578688:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938833.271371:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 386924544 avail 384827392 00000100:00100000:2.0:1784938833.271394:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342578688:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 42us (2856us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938833.271400:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 32 00000100:00080000:1.0:1784938833.272166:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938833.272172:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938833.272175:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938833.273135:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342578688:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938833.273186:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460134c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342578560:192.168.202.104@tcp:13:osp-pre-1-0.0 00010000:00010000:0.0:1784938833.273426:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938834.292634:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784938834.337950:0:31424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8a20d661-ec21-417c-a7ab-df1444b7b9df 00000020:00000080:3.0:1784938834.337962:0:31424:0:(genops.c:906:class_export_put()) final put ffff97471da1f800/8a20d661-ec21-417c-a7ab-df1444b7b9df 00000020:00000080:1.0:1784938834.338083:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97471da1f800/8a20d661-ec21-417c-a7ab-df1444b7b9df for lustre-OST0000 00000020:00000080:1.0:1784938834.338273:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97471da1c800 for lustre-OST0000 00010000:00010000:2.0:1784938835.315218:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:02000000:2.0:1784938835.890872:0:34349:0:(osd_scrub.c:348:osd_scrub_next()) *** cfs_fail_loc=191, val=3*** 00010000:00010000:1.0:1784938836.342627:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784938836.432134:0:33806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8a20d661-ec21-417c-a7ab-df1444b7b9df 00000001:00080000:2.0:1784938836.432158:0:33806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000020:00000080:2.0:1784938836.432163:0:33806:0:(genops.c:906:class_export_put()) final put ffff97473c937000/8a20d661-ec21-417c-a7ab-df1444b7b9df 00000020:00000080:0.0:1784938836.432265:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97473c937000/8a20d661-ec21-417c-a7ab-df1444b7b9df for lustre-MDT0000 00000020:00000080:0.0:1784938836.432336:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97473c934800 for lustre-MDT0000 00000001:00100000:0.0:1784938836.456047:0:32270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8a20d661-ec21-417c-a7ab-df1444b7b9df 00000020:00000080:0.0:1784938836.456058:0:32270:0:(genops.c:906:class_export_put()) final put ffff97471da19000/8a20d661-ec21-417c-a7ab-df1444b7b9df 00000020:00000080:0.0:1784938836.456088:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff97471da19000/8a20d661-ec21-417c-a7ab-df1444b7b9df for lustre-OST0001 00000020:00000080:0.0:1784938836.456134:0:24411:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97471da1c000 for lustre-OST0001 00010000:00010000:0.0:1784938837.365392:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938838.388059:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342578816:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938838.388330:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938838.388367:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342578816 00000100:00100000:2.0:1784938838.388374:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342578816 00000100:00100000:2.0:1784938838.388427:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 33 00000100:00100000:2.0:1784938838.388437:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342578816:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938838.388475:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 384827392 avail 382730240 00000100:00100000:2.0:1784938838.388516:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12805:x1871643342578816:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 80us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938838.388523:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 33 00000100:00080000:2.0:1784938838.388545:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784938838.388585:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938838.389050:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:12803:1871643342579072:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938838.389093:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784938838.389100:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342578944:0@lo:400:kworker.0 00000100:00100000:0.0:1784938838.389137:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938838.389162:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:12803:1871643342579456:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938838.389202:0:33793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342578944 00000100:00100000:0.0:1784938838.389206:0:33793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342578944 00000100:00100000:0.0:1784938838.389242:0:33793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784938838.389250:0:33793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974735590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342578944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938838.389288:0:33793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974735590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342578944:12345-0@lo:400:kworker.0 Request processed in 38us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938838.389294:0:33793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784938838.389367:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938838.389424:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938838.389460:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342578944:0@lo:400:kworker.0 00000100:00100000:0.0:1784938838.389482:0:33801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342579072 00000100:00100000:0.0:1784938838.389485:0:33801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342579072 00000100:00100000:0.0:1784938838.389518:0:33801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342579456 00000100:00100000:0.0:1784938838.389520:0:33801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342579456 00000100:00100000:0.0:1784938838.389538:0:33801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 9 00000100:00100000:0.0:1784938838.389545:0:33801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12803:x1871643342579072:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938838.389586:0:33801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12803:x1871643342579072:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 41us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938838.389593:0:33801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 9 00000100:00100000:0.0:1784938838.389607:0:33801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 10 00000100:00100000:0.0:1784938838.389613:0:33801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12803:x1871643342579456:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938838.389634:0:33801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12803:x1871643342579456:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 22us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938838.389640:0:33801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 10 00000100:00100000:0.0:1784938838.389743:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:12803:1871643342579456:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938838.389802:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:12803:1871643342579072:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938838.389824:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:12804:1871643342579200:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938838.389857:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938838.389863:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342579328:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938838.389946:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938838.389967:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938838.389983:0:33801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342579200 00000100:00100000:0.0:1784938838.389986:0:33801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342579200 00000100:00100000:0.0:1784938838.390010:0:33801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 11 00000100:00100000:0.0:1784938838.390017:0:33801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12804:x1871643342579200:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938838.390046:0:33801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12804:x1871643342579200:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 29us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938838.390052:0:33801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 11 00000100:00100000:0.0:1784938838.390127:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:12804:1871643342579200:192.168.202.104@tcp:400:kworker.0 00000100:00080000:0.0:1784938838.390150:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938838.390182:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:12805:1871643342578816:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938838.390999:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342579328 00000100:00100000:2.0:1784938838.391007:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342579328 00000100:00100000:2.0:1784938838.391062:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 27 00000100:00100000:2.0:1784938838.391071:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342579328:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938838.391117:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342579328:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 48us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938838.391123:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 27 00000100:00100000:2.0:1784938838.391251:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342579328:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938838.391949:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938838.391964:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342579584:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938838.392167:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938838.392559:0:31429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342579584 00000100:00100000:2.0:1784938838.392566:0:31429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342579584 00000100:00100000:2.0:1784938838.392614:0:31429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 34 00000100:00100000:2.0:1784938838.392622:0:31429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342579584:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938838.392654:0:31429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 386924544 avail 384827392 00000100:00100000:2.0:1784938838.392694:0:31429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342579584:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 72us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938838.392708:0:31429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 34 00000100:00080000:0.0:1784938838.395015:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938838.395281:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342579584:192.168.202.104@tcp:13:osp-pre-0-0.0 00010000:00010000:1.0:1784938839.412618:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784938839.694287:0:34547:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1784938839.694332:0:34547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938839.694348:0:34547:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938839.694357:0:34547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938839.694365:0:34547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938839.694388:0:34547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784938839.694393:0:34547:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784938839.694414:0:34547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784938839.694417:0:34547:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784938839.694421:0:34547:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784938839.694440:0:34547:0:(import.c:65:import_set_state_nolock()) ffff974703e9d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784938839.694489:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342579712:192.168.202.104@tcp:39:umount.0 00010000:00010000:0.0:1784938839.694548:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938839.694556:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938839.694563:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045600 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:0.0:1784938839.694567:0:31441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938839.694575:0:31441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938839.694583:0:31441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938839.694590:0:31441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784938839.694592:0:31441:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784938839.694595:0:31441:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784938839.694633:0:31441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938839.694640:0:31441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938839.694679:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938839.694686:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974742045600/0xcd9d312a94a09228 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a0922f expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938839.694711:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938839.694713:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938839.694715:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938839.694740:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938839.694767:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342579840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938839.694832:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938839.694915:0:30615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342579840 00000100:00100000:0.0:1784938839.694923:0:30615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342579840 00000100:00100000:0.0:1784938839.694978:0:30615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784938839.694987:0:30615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12805:x1871643342579840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938839.695000:0:30615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938839.695017:0:30615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974609c46600/0xcd9d312a94a0922f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a09228 expref: 19 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938839.695032:0:30615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938839.695077:0:30615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:12805:x1871643342579840:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938839.695084:0:30615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784938839.695171:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342579840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938839.695284:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938839.695341:0:33798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342579712 00000100:00100000:1.0:1784938839.695345:0:33798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342579712 00000100:00100000:1.0:1784938839.695377:0:33798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 18 00000100:00100000:1.0:1784938839.695383:0:33798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:12801:x1871643342579712:12345-192.168.202.104@tcp:39:umount.0 00000020:00000080:1.0:1784938839.695404:0:33798:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a0942e 00000100:00080000:1.0:1784938839.695418:0:33798:0:(import.c:65:import_set_state_nolock()) ffff974609ce9800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784938839.695598:0:33798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:12801:x1871643342579712:12345-192.168.202.104@tcp:39:umount.0 Request processed in 214us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938839.695607:0:33798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 18 00000020:00000080:1.0:1784938839.695617:0:33798:0:(genops.c:906:class_export_put()) final put ffff974609cef800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1784938839.695647:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784938839.695656:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974609cef800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784938839.695707:0:24411:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974609ce9800 for lustre-MDT0000 00000100:00080000:1.0:1784938839.696167:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974703e9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784938839.696219:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342579712:192.168.202.104@tcp:39:umount.0 00000100:00080000:0.0:1784938839.696441:0:34547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784938839.696445:0:34547:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784938839.696450:0:34547:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784938839.698452:0:34547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938839.698471:0:34547:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938839.698479:0:34547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938839.698486:0:34547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938839.698538:0:34547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938839.698546:0:34547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938839.698553:0:34547:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938839.698584:0:34547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938839.698592:0:34547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.698675:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938839.698682:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.698689:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045a00 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:2.0:1784938839.698693:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.698700:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938839.698707:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938839.698712:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938839.698714:0:30618:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1784938839.698747:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.698788:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938839.698820:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.698827:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974742045a00/0xcd9d312a94a09180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a09187 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938839.698957:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342579968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938839.699035:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938839.699188:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938839.699192:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.699199:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b600 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:2.0:1784938839.699202:0:30618:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.699208:0:30618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938839.699215:0:30618:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938839.699220:0:30618:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938839.699222:0:30618:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1784938839.699237:0:30618:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.699244:0:30618:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938839.699270:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.699280:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938839.699282:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938839.699284:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938839.699329:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938839.699339:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342580096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938839.699364:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938839.699480:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342579968 00000100:00100000:2.0:1784938839.699487:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342579968 00000100:00100000:2.0:1784938839.699533:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342580096 00000100:00100000:2.0:1784938839.699542:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342580096 00000100:00100000:2.0:1784938839.699560:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784938839.699568:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12805:x1871643342579968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938839.699646:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938839.699660:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460290a200/0xcd9d312a94a09187 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a09180 expref: 19 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.699673:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938839.699707:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:12805:x1871643342579968:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938839.699714:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784938839.699730:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784938839.699736:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:12803:x1871643342580096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938839.699743:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938839.699837:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460290aa00/0xcd9d312a94a09259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a09252 expref: 17 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.699962:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938839.700001:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:12803:x1871643342580096:12345-0@lo:103:ldlm_bl.0 Request processed in 265us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938839.700007:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784938839.700035:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342580096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938839.700037:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342579968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938839.700223:0:34547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784938839.700230:0:34547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460290b600/0xcd9d312a94a09252 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a09259 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938839.700242:0:34547:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784938839.700284:0:34547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938839.700292:0:34547:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938839.700299:0:34547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938839.700305:0:34547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938839.700402:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938839.700409:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938839.700427:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974742045800 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:0.0:1784938839.700429:0:31441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938839.700436:0:31441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938839.700441:0:31441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938839.700446:0:31441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784938839.700448:0:31441:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1784938839.700465:0:31441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938839.700471:0:31441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938839.700497:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938839.700505:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938839.700507:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938839.700508:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938839.700550:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938839.700561:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342580224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938839.700665:0:12802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938839.700738:0:30616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342580224 00000100:00100000:3.0:1784938839.700744:0:30616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342580224 00010000:00010000:1.0:1784938839.700766:0:34547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784938839.700771:0:34547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974742045800/0xcd9d312a94a0921a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a09221 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938839.700789:0:34547:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784938839.700811:0:34547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938839.700817:0:30616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784938839.700824:0:30616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:12802:x1871643342580224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938839.700824:0:34547:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938839.700831:0:34547:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938839.700833:0:30616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938839.700837:0:34547:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938839.700843:0:30616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974742045e00/0xcd9d312a94a09221 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a0921a expref: 16 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938839.700853:0:30616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938839.700906:0:30616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:12802:x1871643342580224:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938839.700913:0:30616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784938839.700968:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342580224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938839.700998:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938839.701003:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.701016:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b000 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:2.0:1784938839.701019:0:30619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.701026:0:30619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938839.701032:0:30619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938839.701038:0:30619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938839.701040:0:30619:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1784938839.701059:0:30619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.701065:0:30619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938839.701076:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938839.701084:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938839.701086:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938839.701087:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938839.701092:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938839.701100:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342580352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938839.701126:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784938839.701213:0:34547:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784938839.701218:0:34547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460290b000/0xcd9d312a94a09172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd9d312a94a09179 expref: -99 pid: 33790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938839.701229:0:34547:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1784938839.701233:0:34547:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1784938839.701235:0:34547:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1784938839.701270:0:34547:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1784938839.701275:0:34547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1784938839.701280:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1784938839.701286:0:34547:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:0.0:1784938839.701492:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342580352 00000100:00100000:0.0:1784938839.701498:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342580352 00000100:00100000:0.0:1784938839.701532:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784938839.701538:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:12805:x1871643342580352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938839.701547:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938839.701557:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974742045200/0xcd9d312a94a09179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd9d312a94a09172 expref: 15 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938839.701580:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938839.701627:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:12805:x1871643342580352:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938839.701634:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784938839.703095:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342580352:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1784938839.703484:0:34547:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:2.0:1784938839.704239:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784938839.723148:0:34547:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1784938839.723164:0:34547:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff974609cec000 lustre-MDT0000-lwp-OST0001_UUID 192.168.202.104@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784938839.723171:0:34547:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff974609cec800 lustre-MDT0000-lwp-OST0000_UUID 192.168.202.104@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784938839.723176:0:34547:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff974602f64d40) has exports, disconnecting them 00000020:00080000:3.0:1784938839.723180:0:34547:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.104@tcp (ffff974609cec000), last request at 1784938838 00000020:00000080:3.0:1784938839.723187:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a09427 00000100:00080000:3.0:1784938839.723198:0:34547:0:(import.c:65:import_set_state_nolock()) ffff974609cea800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784938839.723226:0:34547:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.104@tcp (ffff974609cec000): rc 0 00000020:00000080:3.0:1784938839.723229:0:34547:0:(genops.c:906:class_export_put()) final put ffff974609cec000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1784938839.723245:0:34547:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.104@tcp (ffff974609cec800), last request at 1784938838 00000020:00000080:3.0:1784938839.723250:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a09420 00000100:00080000:3.0:1784938839.723255:0:34547:0:(import.c:65:import_set_state_nolock()) ffff974609ceb000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784938839.723262:0:34547:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.104@tcp (ffff974609cec800): rc 0 00000020:00000080:3.0:1784938839.723264:0:34547:0:(genops.c:906:class_export_put()) final put ffff974609cec800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1784938839.723272:0:34547:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa2eec21dfae0 00000100:00080000:3.0:1784938839.723294:0:34547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784938839.723297:0:34547:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967350 gen 3 00000004:00080000:3.0:1784938839.723311:0:34547:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1784938839.723401:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974609cec000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784938839.723450:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974609cec800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784938839.723472:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974609cea800 for lustre-MDT0000 00000020:00000080:1.0:1784938839.723477:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974609ceb000 for lustre-MDT0000 00010000:00010000:2.0:1784938839.723522:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938839.723529:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938839.723696:0:34547:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784938839.723721:0:34547:0:(import.c:65:import_set_state_nolock()) ffff974703e98800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1784938839.723744:0:34547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784938839.724047:0:34547:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967350 gen 3 00000004:00080000:3.0:1784938839.724056:0:34547:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784938839.724115:0:34547:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784938839.724125:0:34547:0:(import.c:65:import_set_state_nolock()) ffff97473a5c9800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1784938839.724155:0:34547:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff974602f64d40) has no exports 00000020:00080000:3.0:1784938839.725136:0:34547:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff974602f64d40) has no exports 00000100:00100000:1.0:1784938839.725445:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342580480:192.168.202.104@tcp:9:umount.0 00000100:00100000:1.0:1784938839.725532:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342580608:192.168.202.104@tcp:9:umount.0 00000100:00100000:1.0:1784938839.725724:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938839.725832:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938839.726071:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342580480 00000100:00100000:2.0:1784938839.726085:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342580480 00000100:00100000:2.0:1784938839.726137:0:31425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342580608 00000100:00100000:2.0:1784938839.726140:0:31425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342580608 00000100:00100000:2.0:1784938839.726167:0:31425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 185 00000100:00100000:2.0:1784938839.726177:0:31425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:12801:x1871643342580480:12345-192.168.202.104@tcp:9:umount.0 00000020:00000080:2.0:1784938839.726204:0:31425:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a091f7 00000100:00080000:2.0:1784938839.726215:0:31425:0:(import.c:65:import_set_state_nolock()) ffff974702c45800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784938839.726248:0:31425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967350 00000100:00100000:1.0:1784938839.726947:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 186 00000100:00100000:1.0:1784938839.726958:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12801:x1871643342580608:12345-192.168.202.104@tcp:9:umount.0 00000020:00000080:1.0:1784938839.726974:0:33065:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a09205 00000100:00080000:1.0:1784938839.726980:0:33065:0:(import.c:65:import_set_state_nolock()) ffff9747102ad000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784938839.727006:0:33065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967350 00000100:00100000:2.0:1784938839.727026:0:31425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:12801:x1871643342580480:12345-192.168.202.104@tcp:9:umount.0 Request processed in 850us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938839.727034:0:31425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 185 00000100:00100000:1.0:1784938839.727211:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:12801:x1871643342580608:12345-192.168.202.104@tcp:9:umount.0 Request processed in 255us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938839.727219:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 186 00010000:00010000:2.0:1784938839.727270:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784938839.727297:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974703e98800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784938839.727315:0:12801:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784938839.727317:0:12801:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938839.727321:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342580480:192.168.202.104@tcp:9:umount.0 00000100:00080000:2.0:1784938839.727334:0:12801:0:(import.c:65:import_set_state_nolock()) ffff97473a5c9800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784938839.727343:0:12801:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784938839.727345:0:12801:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938839.727348:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342580608:192.168.202.104@tcp:9:umount.0 00010000:00010000:2.0:1784938839.727378:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784938839.772059:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a091cd 00000020:00000080:3.0:1784938839.772077:0:34547:0:(genops.c:906:class_export_put()) final put ffff9747360ad800/lustre-QMT0000_UUID 00000020:01000000:3.0:1784938839.772134:0:34547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1784938839.772221:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938839.772232:0:34547:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784938839.772236:0:34547:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff97473bae0000) has no exports 00000020:00000080:1.0:1784938839.772522:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff9747360ad800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784938839.772728:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a091c6 00000020:00000080:2.0:1784938839.772734:0:34547:0:(genops.c:906:class_export_put()) final put ffff974603c34800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784938839.773392:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974603c34800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784938839.776073:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938839.776090:0:34547:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784938839.776097:0:34547:0:(genops.c:906:class_export_put()) final put ffff974603c35000/lustre-QMT0000_UUID 00000020:00000080:2.0:1784938839.776117:0:34547:0:(genops.c:865:class_export_destroy()) destroying export ffff974603c35000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1784938839.776131:0:34547:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1784938839.776250:0:34547:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff974705012360 - data ffff97473ffa0d80/ffff974707af7c00 00000020:01000000:2.0:1784938839.777681:0:34547:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff974705012a80 - data ffff97471e178af8/ffff974707af6c00 00000001:00000004:2.0:1784938839.786079:0:34547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934596 00000100:00080000:1.0:1784938839.913226:0:34547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784938839.913235:0:34547:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967350 gen 4 00000004:00080000:1.0:1784938839.913263:0:34547:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784938839.913266:0:34547:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784938839.915177:0:33821:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784938839.915186:0:33821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:2.0:1784938839.915199:0:33821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1784938839.918487:0:34547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784938839.918496:0:34547:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967350 gen 4 00000004:00080000:1.0:1784938839.918515:0:34547:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784938839.918518:0:34547:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784938839.922781:0:33823:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784938839.922797:0:33823:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1784938839.922818:0:33823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1784938840.041118:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a09195 00000020:00000080:2.0:1784938840.041131:0:34547:0:(genops.c:906:class_export_put()) final put ffff974703e9f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784938840.042225:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a091aa 00000020:00000080:2.0:1784938840.042234:0:34547:0:(genops.c:906:class_export_put()) final put ffff974601dd3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784938840.042241:0:34547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1784938840.042247:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938840.042255:0:34547:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784938840.042259:0:34547:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff974602f619c0) has no exports 00000020:00000080:1.0:1784938840.042979:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974703e9f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784938840.042994:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974601dd3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1784938840.043072:0:34547:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1784938840.043081:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a091fe 00000020:00000080:2.0:1784938840.043086:0:34547:0:(genops.c:906:class_export_put()) final put ffff974703e9e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784938840.043092:0:34547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784938840.043096:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938840.043102:0:34547:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784938840.043105:0:34547:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff974729eacd40) has no exports 00000020:00000080:2.0:1784938840.043112:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a091f0 00000020:00000080:2.0:1784938840.043116:0:34547:0:(genops.c:906:class_export_put()) final put ffff9746020c8000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784938840.043439:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974703e9e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784938840.043445:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff9746020c8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784938840.044027:0:34547:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784938840.044033:0:34547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784938840.044037:0:34547:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967350 gen 5 00000004:00080000:2.0:1784938840.044042:0:34547:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938840.044061:0:34547:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784938840.044152:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938840.044161:0:34547:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938840.044168:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a091e2 00000020:00000080:2.0:1784938840.044175:0:34547:0:(genops.c:906:class_export_put()) final put ffff974706222800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938840.045540:0:24411:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97473a5c9800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784938840.045556:0:24411:0:(genops.c:906:class_export_put()) final put ffff974706227000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938840.045560:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974706227000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784938840.045586:0:24411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784938840.045762:0:34547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784938840.045769:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938840.045786:0:34547:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784938840.045791:0:34547:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff974602f60000) has no exports 00000020:00000080:2.0:1784938840.045806:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a091db 00000020:00000080:2.0:1784938840.045814:0:34547:0:(genops.c:906:class_export_put()) final put ffff974703e9c000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1784938840.046464:0:34547:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784938840.046469:0:34547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784938840.046473:0:34547:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967350 gen 5 00000004:00080000:2.0:1784938840.046478:0:34547:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938840.046481:0:34547:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784938840.046522:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938840.046527:0:34547:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938840.046554:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938840.046556:0:34547:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938840.046559:0:34547:0:(genops.c:906:class_export_put()) final put ffff974703e9c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784938840.046563:0:34547:0:(genops.c:865:class_export_destroy()) destroying export ffff974703e9c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784938840.046567:0:34547:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938840.046688:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a091b1 00000020:00000080:2.0:1784938840.046694:0:34547:0:(genops.c:906:class_export_put()) final put ffff974601dd3000/lustre-MDD0000_UUID 00000020:01000000:2.0:1784938840.046698:0:34547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784938840.046702:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938840.046705:0:34547:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784938840.046708:0:34547:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff974602f63380) has no exports 00000020:00000080:2.0:1784938840.046726:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938840.046729:0:34547:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784938840.046732:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a091b8 00000020:00000080:2.0:1784938840.046743:0:34547:0:(genops.c:906:class_export_put()) final put ffff974601dd1800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784938840.046781:0:34547:0:(tgt_mount.c:187:server_put_mount()) put mount ffff974607ca0800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784938840.046785:0:34547:0:(obd_mount.c:706:lustre_put_lsi()) put ffff974607ca0800 3 00000020:01000004:2.0:1784938840.046789:0:34547:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff974607ca0800 from lustre-MDT0000 00000020:00000080:2.0:1784938840.046816:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938840.046820:0:34547:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784938840.046823:0:34547:0:(genops.c:906:class_export_put()) final put ffff974703e9a800/lustre-MDT0000_UUID 00000020:00000080:2.0:1784938840.046825:0:34547:0:(genops.c:865:class_export_destroy()) destroying export ffff974703e9a800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1784938840.046831:0:34547:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1784938840.046870:0:34547:0:(obd_mount.c:574:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1784938840.046874:0:34547:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784938840.046878:0:34547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784938840.046880:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938840.046883:0:34547:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784938840.047487:0:34547:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff974601255800 754ce9ff-680f-4784-b8fd-fa933d4638f3 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784938840.047494:0:34547:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff974707f2cd40) has exports, disconnecting them 00000020:00080000:2.0:1784938840.047499:0:34547:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff974601255800), last request at 1784938812 00000020:00000080:2.0:1784938840.047515:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a09156 00000020:00010000:2.0:1784938840.047520:0:34547:0:(genops.c:1942:obd_stale_export_put()) Put export ffff974601255800: total 4 00000100:00080000:2.0:1784938840.047525:0:34547:0:(import.c:65:import_set_state_nolock()) ffff974601254000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1784938840.047631:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974706222800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784938840.047638:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974703e9c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784938840.047642:0:24411:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974703e98800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784938840.047647:0:24411:0:(genops.c:906:class_export_put()) final put ffff974601dd5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938840.047659:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974601dd5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1784938840.047663:0:24411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784938840.047744:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974601dd3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1784938840.047748:0:24411:0:(genops.c:906:class_export_put()) final put ffff974703e9e000/lustre-MDD0000_UUID 00000020:00000080:1.0:1784938840.047764:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974703e9e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1784938840.047768:0:24411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00080000:2.0:1784938840.048018:0:34547:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff974601255800): rc 0 00000020:00080000:2.0:1784938840.048023:0:34547:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff974707f2cd40) has no exports 00000020:00000080:1.0:1784938840.049013:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974601dd1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1784938840.049066:0:33794:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff974705b34a00:33794] 1 exiting: rc = 0 00000100:00100000:1.0:1784938840.050366:0:33793:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff974705b34800:33793] 0 exiting: rc = 1 00000020:00010000:3.0:1784938840.051412:0:31441:0:(genops.c:1928:obd_stale_export_get()) Get export ffff974601255800: total 0 00000100:00100000:0.0:1784938840.051570:0:33795:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff974705b34e00:33795] 2 exiting: rc = 0 00000100:00100000:1.0:1784938840.052420:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052429:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052436:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052443:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052450:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052456:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052462:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052468:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052475:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052481:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052486:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052492:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052498:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052504:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052510:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052516:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052534:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052540:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052545:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052552:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052559:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052566:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052572:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052578:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052584:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052590:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052597:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052603:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052609:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052616:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052623:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052629:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052635:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052640:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052645:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052662:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052668:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052674:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052679:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052684:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052689:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052694:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052700:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052705:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052710:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052715:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052720:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052726:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052732:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052738:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052743:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052790:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052812:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052819:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052824:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052830:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052835:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052849:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052855:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052861:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052867:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052873:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052878:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938840.052884:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1784938840.053488:0:34547:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784938840.053492:0:34547:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1784938840.054748:0:34547:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff97473ea04a00/0xcd9d312a94a093fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xcd9d312a94a093f6 expref: 9 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055034:0:34547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97473ea04a00/0xcd9d312a94a093fd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xcd9d312a94a093f6 expref: 9 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055052:0:34547:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff97460290ac00/0xcd9d312a94a092e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xcd9d312a94a092b4 expref: 8 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055062:0:34547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460290ac00/0xcd9d312a94a092e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xcd9d312a94a092b4 expref: 8 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055071:0:34547:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff97460290b200/0xcd9d312a94a093a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xcd9d312a94a09394 expref: 7 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055079:0:34547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460290b200/0xcd9d312a94a093a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xcd9d312a94a09394 expref: 7 pid: 33793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055087:0:34547:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff974709892400/0xcd9d312a94a093e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xcd9d312a94a093da expref: 6 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055109:0:34547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974709892400/0xcd9d312a94a093e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xcd9d312a94a093da expref: 6 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055117:0:34547:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff97473ea04600/0xcd9d312a94a093ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xcd9d312a94a093e8 expref: 5 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055124:0:34547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97473ea04600/0xcd9d312a94a093ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xcd9d312a94a093e8 expref: 5 pid: 33794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055133:0:34547:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff974742045400/0xcd9d312a94a09419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xcd9d312a94a09412 expref: 4 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055141:0:34547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974742045400/0xcd9d312a94a09419 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xcd9d312a94a09412 expref: 4 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055155:0:34547:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff97460290a600/0xcd9d312a94a093d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xcd9d312a94a093cc expref: 3 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055165:0:34547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460290a600/0xcd9d312a94a093d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xcd9d312a94a093cc expref: 3 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055173:0:34547:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff974709892800/0xcd9d312a94a0940b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xcd9d312a94a09404 expref: 2 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938840.055182:0:34547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974709892800/0xcd9d312a94a0940b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xcd9d312a94a09404 expref: 2 pid: 33795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938840.059479:0:31441:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff974601255800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784938840.059507:0:31441:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff974601255800, canceled 0 locks, left on hash table 0. 00000020:00000080:2.0:1784938840.059517:0:31441:0:(genops.c:906:class_export_put()) final put ffff974601255800/754ce9ff-680f-4784-b8fd-fa933d4638f3 00010000:00010000:2.0:1784938840.059545:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938840.059548:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938840.059551:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784938840.059662:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974601255800/754ce9ff-680f-4784-b8fd-fa933d4638f3 for MGS 00000020:00000080:1.0:1784938840.059712:0:24411:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974601254000 for MGS 00010000:00010000:2.0:1784938840.435360:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938841.461422:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784938841.587636:0:32270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784938841.589358:0:32270:0:(genops.c:906:class_export_put()) final put ffff9747102a9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784938841.594809:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9747102a9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784938841.599349:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9747102ad000 for lustre-OST0001 00000020:01000000:1.0:1784938842.099129:0:34547:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff974705190600 - data ffff97472c7696c0/ffff9746047c4c00 00000020:01000000:1.0:1784938842.099258:0:34547:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97473867f300 - data ffff97472c705d80/ffff97471de85800 00000020:00000080:1.0:1784938842.100151:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a0914f 00000020:00000080:1.0:1784938842.100160:0:34547:0:(genops.c:906:class_export_put()) final put ffff97471d9f4000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784938842.100177:0:34547:0:(tgt_mount.c:187:server_put_mount()) put mount ffff974607ca0800 from MGS, refs=2 00000020:01000004:1.0:1784938842.100180:0:34547:0:(obd_mount.c:706:lustre_put_lsi()) put ffff974607ca0800 2 00000020:01000004:1.0:1784938842.100183:0:34547:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff974607ca0800 from MGS 00000020:00000080:1.0:1784938842.100207:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938842.100215:0:34547:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1784938842.100218:0:34547:0:(genops.c:906:class_export_put()) final put ffff97471d9f4800/MGS 00000020:00000080:1.0:1784938842.100220:0:34547:0:(genops.c:865:class_export_destroy()) destroying export ffff97471d9f4800/MGS for MGS 00000020:01000000:1.0:1784938842.100227:0:34547:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1784938842.100285:0:34547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1784938842.100289:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938842.100296:0:34547:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784938842.100305:0:34547:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9747294a9800 lustre-MDT0000-lwp-MDT0000 192.168.202.104@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784938842.100312:0:34547:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff974707f2b380) has exports, disconnecting them 00000020:00080000:1.0:1784938842.100316:0:34547:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 192.168.202.104@tcp (ffff9747294a9800), last request at 1784938812 00000020:00000080:1.0:1784938842.100320:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a0923d 00000020:00080000:1.0:1784938842.100326:0:34547:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.104@tcp (ffff9747294a9800): rc 0 00000020:00000080:1.0:1784938842.100332:0:34547:0:(genops.c:906:class_export_put()) final put ffff9747294a9800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1784938842.101434:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97471d9f4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784938842.101453:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9747294a9800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1784938842.105216:0:34547:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1784938842.105226:0:34547:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938842.105231:0:34547:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784938842.105239:0:34547:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784938842.106582:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974703e9d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784938842.113343:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938842.113361:0:34547:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1784938842.113368:0:34547:0:(genops.c:906:class_export_put()) final put ffff97473c930000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784938842.113478:0:34547:0:(genops.c:865:class_export_destroy()) destroying export ffff97473c930000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784938842.113490:0:34547:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784938842.113565:0:34547:0:(obd_mount.c:706:lustre_put_lsi()) put ffff974607ca0800 1 00000020:00000080:0.0:1784938842.113572:0:34547:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd9d312a94a09141 00000020:00000080:0.0:1784938842.113579:0:34547:0:(genops.c:906:class_export_put()) final put ffff97471d9f3800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1784938842.113588:0:34547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784938842.113593:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938842.113598:0:34547:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784938842.113601:0:34547:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff974708c5b380) has no exports 00000020:00000080:2.0:1784938842.114194:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97471d9f3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784938842.177097:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938842.177117:0:34547:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1784938842.177123:0:34547:0:(genops.c:906:class_export_put()) final put ffff974607ca6000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784938842.177129:0:34547:0:(genops.c:865:class_export_destroy()) destroying export ffff974607ca6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784938842.177141:0:34547:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1784938842.177272:0:34547:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffff974607ca1800 00000020:01000000:2.0:1784938842.177296:0:34547:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1784938842.177322:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938842.177327:0:34547:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784938842.177332:0:34547:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff974609e899c0) has no exports 00000100:00100000:0.0:1784938842.177441:0:33801:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9746020afa00:33801] 2 exiting: rc = 0 00000100:00100000:0.0:1784938842.177538:0:33800:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9746020ae000:33800] 1 exiting: rc = 0 00000100:00100000:1.0:1784938842.185634:0:33798:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9747182be800:33798] 0 exiting: rc = 1 00000100:00100000:1.0:1784938842.185786:0:34170:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff97471831c600:34170] 3 exiting: rc = 0 00000100:00100000:3.0:1784938842.186051:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186059:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186065:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186071:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186076:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186081:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186088:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186096:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186102:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186110:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186115:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186121:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186126:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186132:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186137:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186143:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186148:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186154:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186162:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186167:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186172:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186178:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186184:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186189:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186207:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186212:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186217:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186224:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186230:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186241:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186248:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186253:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186258:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186263:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186270:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186276:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186281:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186287:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186292:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186297:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186303:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186310:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186315:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186320:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186325:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186330:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186335:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186344:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186349:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186357:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186362:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186368:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186374:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186379:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186387:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186396:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186401:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186407:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186412:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186425:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186430:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186436:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186441:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.186447:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.204045:0:33803:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff974735572a00:33803] 1 exiting: rc = 0 00000100:00100000:0.0:1784938842.204257:0:33802:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff974705c7f000:33802] 0 exiting: rc = 1 00000100:00100000:3.0:1784938842.210259:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210269:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210274:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210279:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210284:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210289:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210294:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210299:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210304:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210308:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210314:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210319:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210324:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210330:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210336:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210343:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210348:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210354:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210359:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210364:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210368:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210373:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210378:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210383:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210388:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210393:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210398:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210405:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210411:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210416:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210446:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210451:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210456:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210462:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210469:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210474:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210479:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210484:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210491:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210497:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210503:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210508:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210513:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210520:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210524:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210529:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210534:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210538:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210542:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210547:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210551:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210556:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210560:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210565:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210571:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210575:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210580:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210584:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210588:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210593:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210598:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210603:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210608:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.210613:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.219421:0:33804:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff974735b7c400:33804] 0 exiting: rc = 1 00000100:00100000:0.0:1784938842.220074:0:33807:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff974735b5f400:33807] 1 exiting: rc = 0 00000100:00100000:2.0:1784938842.220181:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220190:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220196:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220203:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220210:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220216:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220223:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220230:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220236:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220242:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220272:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220280:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220286:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220293:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220299:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220323:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220330:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220337:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220342:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220348:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220354:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220361:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220384:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220396:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220403:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220409:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220417:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220426:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220435:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220442:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220449:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220454:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220460:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220467:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220488:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220498:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220503:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220510:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220517:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220523:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220529:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220536:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220543:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220550:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220556:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220562:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220585:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220594:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220600:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220606:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220621:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220628:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220634:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220658:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220667:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220682:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220690:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220700:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220723:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220731:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220737:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220743:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220956:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.220966:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.240167:0:33808:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff974735b5ee00:33808] 0 exiting: rc = 1 00000100:00100000:1.0:1784938842.243365:0:33809:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff974735b5e600:33809] 1 exiting: rc = 0 00000100:00100000:3.0:1784938842.244794:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244828:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244833:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244839:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244844:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244849:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244855:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244860:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244864:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244870:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244875:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244880:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244886:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244891:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244896:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244901:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244905:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244910:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244914:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244919:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244924:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244929:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244935:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244940:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244946:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244952:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244957:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244962:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244967:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244973:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244978:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244982:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244987:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244992:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.244997:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245003:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245017:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245022:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245027:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245033:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245038:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245044:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245050:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245056:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245061:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245066:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245071:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245076:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245081:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245087:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245092:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245098:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245103:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245108:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245114:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245118:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245123:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245128:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245133:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245138:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245143:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245149:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245154:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.245160:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938842.249084:0:33810:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff974735b5f000:33810] 0 exiting: rc = 1 00000100:00100000:1.0:1784938842.249186:0:33811:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff974735b5ec00:33811] 1 exiting: rc = 0 00000100:00100000:3.0:1784938842.249421:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249429:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249434:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249440:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249445:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249450:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249455:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249466:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249471:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249477:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249482:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249487:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249492:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249497:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249502:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249506:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249511:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249516:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249520:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249525:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249529:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249533:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249538:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249542:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249547:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249551:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249555:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249559:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249563:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249568:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249571:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249576:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249580:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249584:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249587:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249592:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249596:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249600:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249604:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249609:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249614:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249619:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249632:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249638:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249654:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249659:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249664:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249677:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249682:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249686:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249691:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249697:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249702:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249707:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249713:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249718:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249723:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249728:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249732:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249736:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249741:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249745:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249839:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.249846:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.250344:0:33812:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff974735b5e000:33812] 0 exiting: rc = 1 00000100:00100000:0.0:1784938842.250531:0:33813:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff974735b5f800:33813] 1 exiting: rc = 0 00000100:00100000:3.0:1784938842.250620:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250625:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250631:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250636:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250651:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250657:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250664:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250780:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250788:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250793:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250798:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250803:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250809:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250963:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250967:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250972:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250977:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250981:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250987:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250991:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.250997:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251002:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251007:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251012:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251017:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251023:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251028:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251034:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251039:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251044:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251049:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251054:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251059:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251065:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251070:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251076:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251080:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251085:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251090:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251095:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251101:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251106:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251111:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251116:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251122:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251126:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251132:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251137:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251152:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251156:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251161:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251166:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251170:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251174:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251179:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251183:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251188:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251192:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251197:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251201:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251206:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251212:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251216:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938842.251222:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.261791:0:33815:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff974706b26e00:33815] 1 exiting: rc = 0 00000100:00100000:0.0:1784938842.262089:0:33814:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9747062b8e00:33814] 0 exiting: rc = 1 00000100:00100000:0.0:1784938842.262295:0:33816:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff97472fc07800:33816] 2 exiting: rc = 0 00000100:00100000:2.0:1784938842.262401:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262408:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262426:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262433:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262439:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262445:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262451:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262456:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262462:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262467:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262471:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262477:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262482:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262487:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262492:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262497:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262502:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262507:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262525:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262531:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262537:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262543:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262548:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262554:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262559:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262564:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262568:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262573:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262578:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262583:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262588:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262593:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262597:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262602:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262608:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262613:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262619:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262624:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262629:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262634:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262639:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262645:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262651:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262656:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262660:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262666:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262679:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262684:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262688:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262693:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262699:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262706:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262711:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262723:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262728:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262734:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262739:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262745:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262779:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262787:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262792:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262799:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262804:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938842.262810:0:34547:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1784938842.272705:0:34547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938842.272719:0:34547:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1784938842.272725:0:34547:0:(genops.c:906:class_export_put()) final put ffff974607ca3800/MDS_uuid 00000020:00000080:2.0:1784938842.272731:0:34547:0:(genops.c:865:class_export_destroy()) destroying export ffff974607ca3800/MDS_uuid for MDS 00000020:01000000:2.0:1784938842.272736:0:34547:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1784938842.272896:0:34547:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1784938842.487192:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938843.507143:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938843.507189:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342580736:0@lo:400:kworker.0 00000400:00000100:1.0:1784938843.507462:0:12804:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643342580736 offset 0 length 224: 4 00000100:00100000:1.0:1784938843.507536:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342580864:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938843.507614:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938843.507621:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342580992:192.168.202.104@tcp:400:kworker.0 00000400:00000100:1.0:1784938843.507845:0:12795:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.104@tcp portal 12 match 1871643342580864 offset 0 length 224: 4 00000400:00000100:1.0:1784938843.507925:0:12795:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.104@tcp portal 12 match 1871643342580992 offset 0 length 224: 4 00010000:00010000:0.0:1784938843.507985:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938844.530950:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784938844.634339:0:31424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938844.634352:0:31424:0:(genops.c:906:class_export_put()) final put ffff974603c33800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938844.634387:0:24411:0:(genops.c:865:class_export_destroy()) destroying export ffff974603c33800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784938844.634440:0:24411:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974702c45800 for lustre-OST0000 00010000:00010000:2.0:1784938845.554944:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938846.587054:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938847.602938:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938848.626917:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938848.628071:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342581376:192.168.202.104@tcp:400:kworker.0 00000400:00000100:1.0:1784938848.628289:0:12795:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.104@tcp portal 12 match 1871643342581376 offset 0 length 224: 4 00000100:00100000:2.0:1784938848.629917:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342581120:0@lo:400:kworker.0 00000400:00000100:2.0:1784938848.629974:0:12804:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643342581120 offset 0 length 224: 4 00000100:00100000:2.0:1784938848.630017:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938848.630025:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342581248:192.168.202.104@tcp:400:kworker.0 00000400:00000100:2.0:1784938848.630205:0:12797:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.202.104@tcp portal 12 match 1871643342581248 offset 0 length 224: 4 00010000:00010000:0.0:1784938849.652664:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938850.674919:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784938851.197586:0:35014:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:2.0:1784938851.197591:0:35014:0:(obd_mount.c:922:lmd_print()) device: lustre-mdt1/mdt1 00000020:01000004:2.0:1784938851.197592:0:35014:0:(obd_mount.c:925:lmd_print()) options: user_xattr 00000080:01200004:2.0:1784938851.197726:0:35014:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff974740e48800 00000020:01000004:2.0:1784938851.197966:0:35014:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784938851.197978:0:35014:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1784938851.197994:0:35014:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff974707f299c0) 00000020:00000080:2.0:1784938851.198010:0:35014:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784938851.230130:0:35014:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1784938851.304606:0:35014:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1784938851.321640:0:35014:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:2.0:1784938851.336164:0:35014:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784938851.336267:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 433: rc = 0 00100000:10000000:2.0:1784938851.336386:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 433: rc = 0 00100000:10000000:2.0:1784938851.338429:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 433: rc = 0 00100000:10000000:2.0:1784938851.338592:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 433: rc = 0 00100000:10000000:3.0:1784938851.347957:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 433: rc = 0 00100000:10000000:3.0:1784938851.348244:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 433: rc = 0 00100000:10000000:3.0:1784938851.350995:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 435: rc = 0 00100000:10000000:3.0:1784938851.367195:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:3.0:1784938851.367300:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:3.0:1784938851.374824:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:2.0:1784938851.380144:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:2.0:1784938851.389954:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1784938851.394013:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1784938851.396586:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1784938851.403619:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:2.0:1784938851.413069:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 645: rc = 0 00100000:10000000:2.0:1784938851.421740:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1784938851.428080:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1784938851.429581:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1784938851.435604:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 645: rc = 0 00100000:10000000:3.0:1784938851.447901:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 645: rc = 0 00100000:10000000:3.0:1784938851.451691:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 204: rc = 0 00100000:10000000:3.0:1784938851.456650:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 204: rc = 0 00100000:10000000:3.0:1784938851.458560:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 204: rc = 0 00100000:10000000:3.0:1784938851.460514:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 204: rc = 0 00100000:10000000:2.0:1784938851.462177:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 204: rc = 0 00100000:10000000:2.0:1784938851.464067:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 204: rc = 0 00100000:10000000:2.0:1784938851.465661:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 204: rc = 0 00100000:10000000:2.0:1784938851.467576:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 204: rc = 0 00100000:10000000:2.0:1784938851.469272:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 204: rc = 0 00100000:10000000:2.0:1784938851.471008:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 204: rc = 0 00100000:10000000:2.0:1784938851.472169:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 204: rc = 0 00100000:10000000:2.0:1784938851.473634:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 204: rc = 0 00100000:10000000:2.0:1784938851.475388:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 204: rc = 0 00100000:10000000:2.0:1784938851.477292:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 204: rc = 0 00100000:10000000:2.0:1784938851.481239:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 204: rc = 0 00100000:10000000:2.0:1784938851.483097:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 204: rc = 0 00100000:10000000:3.0:1784938851.484938:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 204: rc = 0 00100000:10000000:3.0:1784938851.486142:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 204: rc = 0 00100000:10000000:3.0:1784938851.487282:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 204: rc = 0 00100000:10000000:0.0:1784938851.488439:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 204: rc = 0 00100000:10000000:0.0:1784938851.489728:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 204: rc = 0 00100000:10000000:0.0:1784938851.491240:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 204: rc = 0 00100000:10000000:0.0:1784938851.492621:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 204: rc = 0 00100000:10000000:0.0:1784938851.494014:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 204: rc = 0 00100000:10000000:0.0:1784938851.495198:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 204: rc = 0 00100000:10000000:0.0:1784938851.497211:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 204: rc = 0 00100000:10000000:0.0:1784938851.499634:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 204: rc = 0 00100000:10000000:0.0:1784938851.509294:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 204: rc = 0 00100000:10000000:2.0:1784938851.531118:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 204: rc = 0 00100000:10000000:2.0:1784938851.536202:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 204: rc = 0 00100000:10000000:2.0:1784938851.543268:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 204: rc = 0 00100000:10000000:2.0:1784938851.545814:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 204: rc = 0 00100000:10000000:0.0:1784938851.558105:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 549: rc = 0 00100000:10000000:2.0:1784938851.567810:0:35014:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1784938851.573780:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:3.0:1784938851.595232:0:35014:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1784938851.595386:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:3.0:1784938851.600119:0:35014:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1784938851.600260:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:3.0:1784938851.604142:0:35014:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1784938851.604256:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:3.0:1784938851.605546:0:35014:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1784938851.605640:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:3.0:1784938851.606948:0:35014:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1784938851.607043:0:35014:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:1.0:1784938851.607975:0:35015:0:(scrub.c:294:scrub_thread_prep()) lustre-MDT0000: OI scrub prep, flags = 0x8 00100000:10000000:1.0:1784938851.608032:0:35015:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1784938851.608046:0:35015:0:(osd_scrub.c:514:osd_scrub_main()) lustre-MDT0000: OI scrub start, flags = 0x8, pos = 1 00000020:00000080:3.0:1784938851.608505:0:35014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784938851.608514:0:35014:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784938851.608525:0:35014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a094f2 00000020:01000004:3.0:1784938851.608533:0:35014:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1784938851.608541:0:35014:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784938851.608546:0:35014:0:(tgt_mount.c:101:server_register_mount()) register mount ffff974740e48800 from MGS 00000020:01000004:3.0:1784938851.608550:0:35014:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784938851.608559:0:35014:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff974609e88000) 00000020:00000080:3.0:1784938851.608569:0:35014:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784938851.608624:0:35014:0:(tgt_mount.c:153:server_get_mount()) get mount ffff974740e48800 from MGS, refs=2 00080000:01000000:3.0:1784938851.608629:0:35014:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784938851.608633:0:35014:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a09500 00010000:00010000:3.0:1784938851.608811:0:35014:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:0.0:1784938851.662615:0:35014:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1784938851.662635:0:35014:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784938851.662638:0:35014:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1784938851.666342:0:35017:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784938851.666608:0:35014:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784938851.667006:0:35014:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784938851.677234:0:35014:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784938851.677580:0:35014:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938851.678439:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784938851.678448:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784938851.681368:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784938851.681381:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784938851.681822:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784938851.681829:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784938851.682341:0:35014:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784938851.682372:0:35014:0:(obd_mount.c:395:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1784938851.682374:0:35014:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1784938851.682377:0:35014:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:3.0:1784938851.682383:0:35014:0:(import.c:65:import_set_state_nolock()) ffff974736697800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1784938851.682390:0:35014:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1784938851.700203:0:35014:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.104@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1784938851.700210:0:35014:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1784938851.700222:0:35014:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff974603682300 x1871643342580736/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784938859 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938851.700244:0:35014:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff974603683100 x1871643342581120/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784938864 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784938851.700255:0:35014:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1784938851.700258:0:35014:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1784938851.700259:0:35014:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784938851.700262:0:35014:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1784938851.701296:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342581120:0@lo:400:kworker.0 00000100:00100000:2.0:1784938851.701318:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342580736:0@lo:400:kworker.0 00010000:00010000:2.0:1784938851.701393:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784938851.701405:0:35014:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1784938851.701424:0:35014:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97473ea04e00/0xcd9d312a94a093f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a093fd expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938851.701435:0:35014:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97473ea04e00/0xcd9d312a94a093f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a093fd expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938851.701442:0:35014:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784938851.701457:0:35014:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784938851.701466:0:35014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97473ea04e00/0xcd9d312a94a093f6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a093fd expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938851.701485:0:35014:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a092b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a092e5 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938851.701517:0:35014:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a092b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a092e5 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938851.701522:0:35014:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938851.701527:0:35014:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784938851.701531:0:35014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a092b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a092e5 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938851.701542:0:35014:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974742044a00/0xcd9d312a94a09394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a093a2 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938851.701548:0:35014:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974742044a00/0xcd9d312a94a09394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a093a2 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938851.701554:0:35014:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938851.701557:0:35014:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784938851.701560:0:35014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974742044a00/0xcd9d312a94a09394 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a093a2 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938851.701570:0:35014:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460290a000/0xcd9d312a94a093da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a093e1 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938851.701575:0:35014:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460290a000/0xcd9d312a94a093da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a093e1 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938851.701580:0:35014:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938851.701583:0:35014:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784938851.701586:0:35014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460290a000/0xcd9d312a94a093da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a093e1 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938851.701608:0:35014:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974709892c00/0xcd9d312a94a093e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a093ef expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938851.701614:0:35014:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974709892c00/0xcd9d312a94a093e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a093ef expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938851.701619:0:35014:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938851.701623:0:35014:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784938851.701627:0:35014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974709892c00/0xcd9d312a94a093e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a093ef expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938851.701637:0:35014:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97473ea05800/0xcd9d312a94a09412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a09419 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938851.701642:0:35014:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97473ea05800/0xcd9d312a94a09412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a09419 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938851.701646:0:35014:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938851.701649:0:35014:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784938851.701652:0:35014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97473ea05800/0xcd9d312a94a09412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a09419 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938851.701663:0:35014:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460290b400/0xcd9d312a94a093cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a093d3 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938851.701669:0:35014:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460290b400/0xcd9d312a94a093cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a093d3 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938851.701674:0:35014:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784938851.701697:0:35014:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784938851.701702:0:35014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460290b400/0xcd9d312a94a093cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a093d3 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938851.701711:0:35014:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97473ea05e00/0xcd9d312a94a09404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xcd9d312a94a0940b expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938851.701718:0:35014:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97473ea05e00/0xcd9d312a94a09404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xcd9d312a94a0940b expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938851.701722:0:35014:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784938851.701725:0:35014:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1784938851.701728:0:35014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97473ea05e00/0xcd9d312a94a09404 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xcd9d312a94a0940b expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784938851.701771:0:35014:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff974736697800 already not connected (conn 2, was 0): DISCONN 00000100:00080000:2.0:1784938851.701777:0:35014:0:(import.c:65:import_set_state_nolock()) ffff974736697800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938851.701783:0:35014:0:(import.c:510:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 965 00000100:00080000:2.0:1784938851.701791:0:35014:0:(import.c:624:import_select_connection()) MGC192.168.202.104@tcp: import ffff974736697800 using connection 754ce9ff-680f-4784-b8fd-fa933d4638f3/0@lo 00000100:00100000:2.0:1784938851.701826:0:35014:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97460a357480 x1871643342581504/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938851.701846:0:35014:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1784938851.701877:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:754ce9ff-680f-4784-b8fd-fa933d4638f3:12801:1871643342581504:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784938851.701954:0:12801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938851.702021:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342581504 00000100:00100000:2.0:1784938851.702029:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342581504 00000100:00100000:2.0:1784938851.702062:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784938851.702069:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473e3d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:12801:x1871643342581504:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1784938851.702093:0:35020:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from 754ce9ff-680f-4784-b8fd-fa933d4638f3@0@lo t0 exp 0000000000000000 cur 1005 last 0 00000020:00000080:2.0:1784938851.702126:0:35020:0:(genops.c:1406:class_connect()) connect: client 754ce9ff-680f-4784-b8fd-fa933d4638f3, cookie 0xcd9d312a94a09507 00000100:00080000:2.0:1784938851.702260:0:35020:0:(import.c:65:import_set_state_nolock()) ffff974602e34800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938851.702312:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473e3d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+5:12801:x1871643342581504:12345-0@lo:250:mount.lustre.0 Request processed in 242us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938851.702320:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784938851.702358:0:12801:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.104@tcp: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784938851.702366:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.104@tcp: connect to target with instance 0 00000100:00080000:2.0:1784938851.702372:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784938851.702376:0:12801:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784938851.702381:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974736697800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784938851.702384:0:12801:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784938851.702401:0:12801:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784938851.702408:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:754ce9ff-680f-4784-b8fd-fa933d4638f3:12801:1871643342581504:0@lo:250:mount.lustre.0 00000020:01000000:2.0:1784938851.702459:0:36:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.104@tcp 10000000:01000000:2.0:1784938851.702476:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1784938851.702479:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784938851.702480:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784938851.702482:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938851.702483:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938851.702484:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938851.702485:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938851.702487:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938851.702489:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938851.702490:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784938851.702518:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1784938851.702524:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1784938851.702527:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784938851.702528:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784938851.702529:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938851.702530:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938851.702531:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938851.702533:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938851.702534:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938851.702540:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938851.702541:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784938851.702564:0:36:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1784938851.702599:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342581632:0@lo:253:kworker.0 00000100:00100000:2.0:1784938851.702633:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938851.702668:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342581760:0@lo:253:kworker.0 00000100:00100000:2.0:1784938851.702713:0:12804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784938851.702740:0:35014:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1784938851.702775:0:35014:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784938851.702782:0:35014:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1784938851.702795:0:35014:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff974707f2b380) 00000020:00000080:2.0:1784938851.702807:0:35014:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1784938851.708091:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342581632 00000100:00100000:0.0:1784938851.708104:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342581632 00000100:00100000:0.0:1784938851.708139:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342581760 00000100:00100000:0.0:1784938851.708142:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342581760 00000100:00100000:0.0:1784938851.708159:0:35021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784938851.708167:0:35021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473e3d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:12803:x1871643342581632:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1784938851.708201:0:35021:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:1.0:1784938851.708791:0:35023:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784938851.709200:0:35021:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 00000100:00100000:3.0:1784938851.720153:0:35014:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938851.720326:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1784938851.720332:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1784938851.720512:0:35022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784938851.720528:0:35022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473e3d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:12804:x1871643342581760:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1784938851.720587:0:35022:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1784938851.723974:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1784938851.723988:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1784938851.728571:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1784938851.728585:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1784938851.737177:0:35014:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938851.737369:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1784938851.737375:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1784938851.741279:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1784938851.741292:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 20000000:01000000:2.0:1784938851.745986:0:35027:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1784938851.745993:0:35027:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1784938851.745996:0:35027:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1784938851.746052:0:35027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 20000000:01000000:2.0:1784938851.746246:0:35021:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784938851.746269:0:35021:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784938851.812705:0:35014:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938851.812970:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1784938851.812976:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1784938851.814488:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1784938851.814506:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1784938851.815143:0:35014:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938851.815341:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784938851.815348:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1784938851.815773:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784938851.815780:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784938851.816599:0:35014:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938851.816812:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784938851.816818:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1784938851.817335:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784938851.817342:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1784938851.817812:0:35014:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938851.818201:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784938851.818207:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1784938851.818995:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784938851.819007:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 20000000:01000000:3.0:1784938851.824720:0:35022:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784938851.829166:0:35021:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784938851.829186:0:35021:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784938851.829474:0:35023:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784938851.829480:0:35023:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784938851.829507:0:35023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97460290b800/0xcd9d312a94a09515 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.829523:0:35023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460290b800/0xcd9d312a94a09515 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938851.829534:0:35023:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054600s 00010000:00010000:1.0:1784938851.829539:0:35023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97460290b800/0xcd9d312a94a09515 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.829546:0:35023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97460290b800/0xcd9d312a94a09515 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.829554:0:35023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97460290b800/0xcd9d312a94a09515 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.829561:0:35023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97460290b800/0xcd9d312a94a09515 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.829569:0:35023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938851.829573:0:35023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97460290b800/0xcd9d312a94a09515 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.829582:0:35023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97460290b800/0xcd9d312a94a09515 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.829595:0:35023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97460290b800/0xcd9d312a94a09515 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.829604:0:35023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97460290b800/0xcd9d312a94a09515 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.829620:0:35023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460290b800/0xcd9d312a94a09515 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938851.856156:0:35014:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938851.856334:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784938851.856340:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1784938851.866433:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784938851.866452:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1784938851.868207:0:35014:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784938851.868222:0:35014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 20000000:01000000:1.0:1784938851.869106:0:35022:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784938851.869119:0:35022:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784938851.869170:0:35023:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784938851.869176:0:35023:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784938851.869207:0:35023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97460290b800/0xcd9d312a94a0951c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.869226:0:35023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460290b800/0xcd9d312a94a0951c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938851.869238:0:35023:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000063331s 00010000:00010000:1.0:1784938851.869243:0:35023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97460290b800/0xcd9d312a94a0951c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.869251:0:35023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97460290b800/0xcd9d312a94a0951c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.869260:0:35023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97460290b800/0xcd9d312a94a0951c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.869268:0:35023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97460290b800/0xcd9d312a94a0951c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.869275:0:35023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938851.869280:0:35023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97460290b800/0xcd9d312a94a0951c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.869289:0:35023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97460290b800/0xcd9d312a94a0951c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.869315:0:35023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97460290b800/0xcd9d312a94a0951c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.869323:0:35023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97460290b800/0xcd9d312a94a0951c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.869330:0:35023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97460290b800/0xcd9d312a94a0951c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784938851.870452:0:35014:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1784938851.870478:0:35014:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1784938851.870486:0:35014:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1784938851.870609:0:35014:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784938851.870644:0:35014:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1784938851.870649:0:35014:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784938851.870651:0:35014:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784938851.870653:0:35014:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938851.870654:0:35014:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938851.870656:0:35014:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938851.870657:0:35014:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938851.870659:0:35014:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938851.870661:0:35014:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784938851.870663:0:35014:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938851.870664:0:35014:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784938851.870667:0:35014:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1784938851.870670:0:35014:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784938851.870671:0:35014:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784938851.870672:0:35014:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938851.870674:0:35014:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938851.870687:0:35014:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938851.870688:0:35014:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938851.870689:0:35014:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938851.870690:0:35014:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784938851.870691:0:35014:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938851.870698:0:35014:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784938851.870726:0:35014:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784938851.870781:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342581888:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784938851.870857:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938851.870906:0:35020:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1784938851.870913:0:35020:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1784938851.870944:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718548000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938851.877049:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342581888 00000100:00100000:3.0:1784938851.877064:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342581888 00000100:00100000:0.0:1784938851.877270:0:35045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784938851.877282:0:35045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473e3d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+7:35014:x1871643342581888:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784938851.877352:0:35045:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784938851.877355:0:35045:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784938851.877358:0:35045:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1784938851.877366:0:35045:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784938851.898260:0:35022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473e3d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+7:12804:x1871643342581760:12345-0@lo:253:kworker.0 Request processed in 177728us (195535us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938851.898276:0:35022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:1.0:1784938851.898362:0:12804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784938851.898365:0:12804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784938851.898367:0:12804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938851.898368:0:12804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938851.898369:0:12804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938851.898371:0:12804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938851.898373:0:12804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938851.898375:0:12804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938851.898376:0:12804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784938851.898380:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754ce9ff-680f-4784-b8fd-fa933d4638f3:12804:1871643342581760:0@lo:253:kworker.0 00000100:00100000:2.0:1784938851.898893:0:35021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473e3d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:12803:x1871643342581632:12345-0@lo:253:kworker.0 Request processed in 190724us (196258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938851.898905:0:35021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:1.0:1784938851.899322:0:12803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784938851.899325:0:12803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784938851.899327:0:12803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938851.899328:0:12803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938851.899329:0:12803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938851.899330:0:12803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938851.899331:0:12803:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938851.899333:0:12803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938851.899334:0:12803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784938851.899338:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342581632:0@lo:253:kworker.0 00000100:00100000:1.0:1784938851.900012:0:35045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473e3d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+5:35014:x1871643342581888:12345-0@lo:253:mount.lustre.0 Request processed in 22731us (29153us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938851.900024:0:35045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784938851.900121:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342581888:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784938851.900138:0:35014:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784938851.900141:0:35014:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784938851.900143:0:35014:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938851.900144:0:35014:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938851.900145:0:35014:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938851.900146:0:35014:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938851.900148:0:35014:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938851.900149:0:35014:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938851.900151:0:35014:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938851.900153:0:35014:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938851.900154:0:35014:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784938851.900175:0:35014:0:(tgt_mount.c:101:server_register_mount()) register mount ffff974740e48800 from lustre-MDT0000 10000000:01000000:0.0:1784938851.900218:0:35014:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784938851.900222:0:35014:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784938851.900252:0:35014:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff974740e48800 10000000:01000000:0.0:1784938851.900257:0:35014:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784938851.900262:0:35014:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff974740e48800 10000000:01000000:0.0:1784938851.900266:0:35014:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784938851.900269:0:35014:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff974740e48800 from 1 10000000:01000000:0.0:1784938851.900272:0:35014:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784938851.900324:0:35014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97473ea04600/0xcd9d312a94a09523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938851.900336:0:35014:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97473ea04600/0xcd9d312a94a09523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938851.900347:0:35014:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97473ea04600/0xcd9d312a94a09523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938851.900372:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342582016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938851.900413:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938851.900459:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747057f0780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938851.900567:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342582016 00000100:00100000:1.0:1784938851.900580:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342582016 00000100:00100000:1.0:1784938851.900619:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784938851.900628:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473e3d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+5:35014:x1871643342582016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938851.900641:0:35020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938851.900657:0:35020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460290b800/0xcd9d312a94a0952a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a09523 expref: -99 pid: 35020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.900720:0:35020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460290b800/0xcd9d312a94a0952a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a09523 expref: 6 pid: 35020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.900732:0:35020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460290b800/0xcd9d312a94a0952a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a09523 expref: 6 pid: 35020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938851.900777:0:35020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460290b800, rc 0) 00000100:00100000:1.0:1784938851.900809:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473e3d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:35014:x1871643342582016:12345-0@lo:101:mount.lustre.0 Request processed in 182us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938851.900816:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784938851.900946:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342582016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938851.900960:0:35014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97473ea04600/0xcd9d312a94a09523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a0952a expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938851.900970:0:35014:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97473ea04600/0xcd9d312a94a09523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a0952a expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938851.900984:0:35014:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784938851.901052:0:35014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97473ea04600/0xcd9d312a94a09523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a0952a expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938851.901061:0:35014:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97473ea04600/0xcd9d312a94a09523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a0952a expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938851.901073:0:35014:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784938851.901077:0:35014:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784938851.901082:0:35014:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff974740e48800 10000000:01000000:0.0:1784938851.901084:0:35014:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784938851.901087:0:35014:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784938851.901090:0:35014:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784938851.901105:0:35014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97473ea04400/0xcd9d312a94a09531 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938851.901112:0:35014:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97473ea04400/0xcd9d312a94a09531 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938851.901120:0:35014:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97473ea04400/0xcd9d312a94a09531 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938851.901133:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342582144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938851.901159:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938851.901177:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747057f0780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938851.903014:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342582144 00000100:00100000:3.0:1784938851.903025:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342582144 00000100:00100000:3.0:1784938851.903085:0:35021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784938851.903094:0:35021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97473e3d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+6:35014:x1871643342582144:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938851.903109:0:35021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938851.903129:0:35021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97460209b000/0xcd9d312a94a09538 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a09531 expref: -99 pid: 35021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938851.903151:0:35021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97460209b000/0xcd9d312a94a09538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a09531 expref: 7 pid: 35021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938851.903162:0:35021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97460209b000/0xcd9d312a94a09538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a09531 expref: 7 pid: 35021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938851.903170:0:35021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97460209b000, rc 0) 00000100:00100000:3.0:1784938851.903242:0:35021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97473e3d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+7:35014:x1871643342582144:12345-0@lo:101:mount.lustre.0 Request processed in 148us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938851.903249:0:35021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784938851.903397:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342582144:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938851.903419:0:35014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97473ea04400/0xcd9d312a94a09531 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09538 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938851.903430:0:35014:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97473ea04400/0xcd9d312a94a09531 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09538 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938851.903525:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342582272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938851.903559:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938851.903603:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747057f0780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938851.903736:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342582272 00000100:00100000:1.0:1784938851.903765:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342582272 00000100:00100000:1.0:1784938851.903794:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784938851.903802:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+7:35014:x1871643342582272:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938851.904194:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:35014:x1871643342582272:12345-0@lo:501:mount.lustre.0 Request processed in 392us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938851.904202:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784938851.904370:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342582272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938851.904405:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342582400:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938851.904446:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938851.904545:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747057f0780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938851.905619:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342582400 00000100:00100000:3.0:1784938851.905630:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342582400 00000100:00100000:3.0:1784938851.905702:0:35021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784938851.905712:0:35021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:35014:x1871643342582400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938851.928107:0:35021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:35014:x1871643342582400:12345-0@lo:503:mount.lustre.0 Request processed in 22383us (23647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938851.928138:0:35021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784938851.929890:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342582400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938851.931504:0:35046:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:35046:1871643342582528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938851.931589:0:35046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938851.931633:0:35046:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0cae40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938851.931733:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342582528 00000100:00100000:3.0:1784938851.931778:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342582528 00000100:00100000:3.0:1784938851.931825:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938851.931836:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:35046:x1871643342582528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938851.940003:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:35046:x1871643342582528:12345-0@lo:502:llog_process_th.0 Request processed in 8153us (8399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938851.940037:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784938851.940125:0:35046:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:35046:1871643342582528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938851.940162:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938851.940174:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938851.940176:0:35046:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784938851.940183:0:35046:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784938851.940186:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938851.940200:0:35046:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff974729eacd40) 00000020:00000080:1.0:1784938851.940222:0:35046:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1784938851.940228:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784938851.940316:0:35046:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784938851.940324:0:35046:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a09546 00000020:00000080:1.0:1784938851.940547:0:35046:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784938851.940551:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938851.940554:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938851.940555:0:35046:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784938851.940558:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938851.940561:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938851.940563:0:35046:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1784938851.940566:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938851.940573:0:35046:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff974729ea8000) 00000020:00000080:1.0:1784938851.940584:0:35046:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1784938851.940587:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784938851.940589:0:35046:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1784938851.940593:0:35046:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1784938851.940598:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784938851.940641:0:35046:0:(tgt_mount.c:153:server_get_mount()) get mount ffff974740e48800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784938851.940652:0:35046:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff974729eab380) 00000020:00000080:1.0:1784938851.940660:0:35046:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1784938851.940721:0:35046:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784938851.940727:0:35046:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a0955b 00000020:00000080:1.0:1784938851.940851:0:35046:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1784938851.940858:0:35046:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784938851.940862:0:35046:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcd9d312a94a09562 00080000:01000000:1.0:1784938851.940867:0:35046:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784938851.940871:0:35046:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a09569 00080000:00020000:2.0:1784938851.992281:0:35015:0:(osd_index.c:203:__osd_xattr_load_by_oid()) lustre-MDT0000: can't get bonus, rc = -17 00100000:10000000:2.0:1784938851.999606:0:35015:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 2, force no, [0x200000401:0x45:0x0] => 916 (null): rc = 0 00100000:10000000:0.0:1784938852.018589:0:35015:0:(scrub.c:368:scrub_thread_post()) lustre-MDT0000: OI scrub post with result = 1 00100000:10000000:0.0:1784938852.018691:0:35015:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1784938852.018695:0:35015:0:(osd_scrub.c:561:osd_scrub_main()) lustre-MDT0000: OI scrub: stop, pos = 35184372088832: rc = 1 00010000:00010000:2.0:1784938852.040231:0:35046:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-3 is initialized 00000001:00000004:2.0:1784938852.041289:0:35046:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934596 00000001:00080000:2.0:1784938852.041478:0:35046:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784938852.042130:0:35046:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff974707f2cd40) 00000020:00000080:2.0:1784938852.042152:0:35046:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784938852.042212:0:35046:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784938852.042218:0:35046:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a09577 00000020:00000080:2.0:1784938852.042655:0:35046:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784938852.045538:0:35046:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcd9d312a94a0957e 00000020:00000080:2.0:1784938852.050905:0:35046:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784938852.050922:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938852.050931:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938852.050933:0:35046:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784938852.050937:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938852.050943:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938852.050945:0:35046:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784938852.050949:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784938852.050993:0:35046:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784938852.051009:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938852.051011:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938852.051013:0:35046:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1784938852.051015:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784938852.051018:0:35046:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1784938852.051019:0:35046:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784938852.051020:0:35046:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784938852.051022:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784938852.051024:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938852.051032:0:35046:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784938852.051035:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784938852.051038:0:35046:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1784938852.051041:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938852.051042:0:35046:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784938852.051045:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784938852.051050:0:35046:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:2.0:1784938852.051076:0:35046:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784938852.051079:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784938852.051093:0:35046:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff974708c5b380) 00000020:00000080:2.0:1784938852.051113:0:35046:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1784938852.051117:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784938852.051191:0:35046:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1784938852.051197:0:35046:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784938852.051204:0:35046:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a0958c 00010000:00080000:2.0:1784938852.051239:0:35046:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9747061e8000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:2.0:1784938852.051451:0:35046:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1784938852.052975:0:35046:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784938852.053027:0:35046:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784938852.058310:0:35046:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938852.059568:0:35046:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1784938852.059650:0:35046:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1784938852.060194:0:35050:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1784938852.060200:0:35050:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784938852.060958:0:35046:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938852.060970:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784938852.061000:0:35046:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784938852.061018:0:35046:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a09593 00000100:00080000:2.0:1784938852.061030:0:35046:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.202.104@tcp last attempt 0 00000100:00080000:2.0:1784938852.061042:0:35046:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9747061e8000 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:2.0:1784938852.061078:0:35046:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97460a356300 x1871643342582656/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.202.104@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938852.061148:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342582656:192.168.202.104@tcp:8:llog_process_th.0 00000100:00100000:1.0:1784938852.061426:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938852.061458:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342582656 00000100:00100000:1.0:1784938852.061465:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342582656 00000100:00100000:1.0:1784938852.061494:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 187 00000100:00100000:1.0:1784938852.061501:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:12801:x1871643342582656:12345-192.168.202.104@tcp:8:llog_process_th.0 00010000:00080000:1.0:1784938852.061523:0:31427:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 1005 last 0 00000020:00000080:1.0:1784938852.061546:0:31427:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a0959a 00002000:00100000:1.0:1784938852.061556:0:31427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97473c933800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784938852.061560:0:31427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1784938852.061563:0:31427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784938852.061805:0:31427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784938852.061831:0:31427:0:(import.c:65:import_set_state_nolock()) ffff97473c934800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938852.061876:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:12801:x1871643342582656:12345-192.168.202.104@tcp:8:llog_process_th.0 Request processed in 374us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938852.061884:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 187 00000100:00080000:2.0:1784938852.062123:0:35046:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1784938852.062202:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938852.062207:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938852.062209:0:35046:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784938852.062212:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784938852.062215:0:35046:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1784938852.062217:0:35046:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784938852.062218:0:35046:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784938852.062220:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784938852.062223:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938852.062224:0:35046:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784938852.062227:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784938852.062231:0:35046:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1784938852.062234:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938852.062236:0:35046:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784938852.062239:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784938852.062243:0:35046:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:2.0:1784938852.062261:0:35046:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784938852.062264:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784938852.062277:0:35046:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff974602f63380) 00000020:00000080:2.0:1784938852.062291:0:35046:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1784938852.062296:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784938852.062375:0:35046:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784938852.062380:0:35046:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1784938852.062387:0:35046:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd9d312a94a095a8 00010000:00080000:2.0:1784938852.062416:0:35046:0:(ldlm_lib.c:125:import_set_conn()) imp ffff9747360dd800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:2.0:1784938852.062625:0:35046:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-4 is initialized 00000040:01000000:2.0:1784938852.062815:0:35046:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784938852.062838:0:35046:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1784938852.063192:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342582784:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938852.063266:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342582912:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938852.063384:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938852.063460:0:35025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342582784 00000100:00100000:3.0:1784938852.063467:0:35025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342582784 00000100:00100000:3.0:1784938852.063498:0:35025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:3.0:1784938852.063505:0:35025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:12805:x1871643342582784:12345-192.168.202.104@tcp:400:kworker.0 00000020:00080000:3.0:1784938852.063513:0:35025:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.104@tcp 00000100:00100000:3.0:1784938852.063540:0:35025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:12805:x1871643342582784:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 33us (156us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784938852.063546:0:35025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00080000:3.0:1784938852.063629:0:12805:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@192.168.202.104@tcp abruptly disconnected: reconnecting 00000100:00080000:3.0:1784938852.063633:0:12805:0:(import.c:65:import_set_state_nolock()) ffff974718b1c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784938852.063637:0:12805:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 192.168.202.104@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000040:00080000:2.0:1784938852.068016:0:35046:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938852.068446:0:35046:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1784938852.068517:0:35046:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00080000:3.0:1784938852.070517:0:12805:0:(import.c:65:import_set_state_nolock()) ffff974718b1c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938852.070534:0:12805:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.202.104@tcp last attempt 971 00000100:00080000:3.0:1784938852.070553:0:12805:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff974718b1c800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:3.0:1784938852.070599:0:12805:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974602fb5880 x1871643342583040/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938852.070622:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342582784:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938852.070960:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000040:00080000:3.0:1784938852.071439:0:35052:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1784938852.071445:0:35052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1784938852.071578:0:12801:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938852.071588:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784938852.071598:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784938852.071603:0:12801:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784938852.071607:0:12801:0:(import.c:65:import_set_state_nolock()) ffff9747061e8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784938852.071619:0:12801:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784938852.071627:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342582656:192.168.202.104@tcp:8:llog_process_th.0 00000100:00100000:0.0:1784938852.071650:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342583040:192.168.202.104@tcp:38:ptlrpcd_00_03.0 00000004:00080000:0.0:1784938852.071793:0:35050:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784938852.071908:0:35050:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1005909155575ns, next at 0ns, rc = 0 00000100:00100000:2.0:1784938852.072072:0:35029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342582912 00000100:00100000:2.0:1784938852.072085:0:35029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342582912 00000100:00100000:2.0:1784938852.072123:0:35029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:2.0:1784938852.072131:0:35029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:12802:x1871643342582912:12345-192.168.202.104@tcp:400:kworker.0 00000020:00080000:2.0:1784938852.072140:0:35029:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.104@tcp 00000100:00100000:2.0:1784938852.072173:0:35029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:12802:x1871643342582912:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 42us (1215us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784938852.072181:0:35029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:3.0:1784938852.072388:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00080000:3.0:1784938852.072432:0:12802:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@192.168.202.104@tcp abruptly disconnected: reconnecting 00000100:00080000:3.0:1784938852.072437:0:12802:0:(import.c:65:import_set_state_nolock()) ffff974729ece000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784938852.072441:0:12802:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 192.168.202.104@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784938852.072446:0:12802:0:(import.c:65:import_set_state_nolock()) ffff974729ece000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938852.072456:0:12802:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.202.104@tcp last attempt 971 00000100:00080000:3.0:1784938852.072463:0:12802:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff974729ece000 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:3.0:1784938852.072483:0:12802:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974602fb7480 x1871643342583296/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938852.072502:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342582912:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938852.072516:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938852.072527:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342583168:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938852.072583:0:35028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342583040 00000100:00100000:3.0:1784938852.072587:0:35028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342583040 00000100:00100000:3.0:1784938852.072606:0:35028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:3.0:1784938852.072611:0:35028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12801:x1871643342583040:12345-192.168.202.104@tcp:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784938852.072643:0:35028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12801:x1871643342583040:12345-192.168.202.104@tcp:38:ptlrpcd_00_03.0 Request processed in 30us (256us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784938852.072649:0:35028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:3.0:1784938852.072667:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342583296:192.168.202.104@tcp:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784938852.072869:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938852.072905:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00080000:3.0:1784938852.073046:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974718b1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938852.073052:0:12801:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.104@tcp failed (-11) 00000100:00100000:3.0:1784938852.073056:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342583040:192.168.202.104@tcp:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784938852.073074:0:35028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342583296 00000100:00100000:3.0:1784938852.073078:0:35028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342583296 00000100:00100000:3.0:1784938852.073103:0:35028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00100000:3.0:1784938852.073109:0:35028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12801:x1871643342583296:12345-192.168.202.104@tcp:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784938852.073145:0:35028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12801:x1871643342583296:12345-192.168.202.104@tcp:38:ptlrpcd_00_00.0 Request processed in 34us (238us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784938852.073159:0:35028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00080000:3.0:1784938852.073248:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974729ece000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938852.073253:0:12801:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.104@tcp failed (-11) 00000100:00100000:3.0:1784938852.073257:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342583296:192.168.202.104@tcp:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1784938852.074102:0:31430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342583168 00000100:00100000:1.0:1784938852.074109:0:31430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342583168 00000100:00100000:1.0:1784938852.074160:0:31430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 35 00000100:00100000:1.0:1784938852.074168:0:31430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:12802:x1871643342583168:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938852.074204:0:31430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 386924544 avail 384827392 00000100:00100000:1.0:1784938852.074253:0:31430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:12802:x1871643342583168:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 85us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938852.074271:0:31430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 35 00000100:00100000:1.0:1784938852.074419:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342583168:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00080000:0.0:1784938852.074482:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1784938852.074919:0:35046:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784938852.074935:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784938852.074979:0:35046:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784938852.075001:0:35046:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a095af 00000100:00080000:0.0:1784938852.075009:0:35046:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.202.104@tcp last attempt 0 00000100:00080000:0.0:1784938852.075016:0:35046:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9747360dd800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:0.0:1784938852.075044:0:35046:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974608ff8000 x1871643342583424/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.202.104@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938852.075071:0:35046:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784938852.075118:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938852.075122:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938852.075124:0:35046:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784938852.075128:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938852.075133:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938852.075134:0:35046:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784938852.075137:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784938852.075139:0:35046:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784938852.075169:0:35046:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:35046:1871643342583552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938852.075229:0:35046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938852.075261:0:35046:0:(client.c:2702:ptlrpc_set_wait()) set ffff974707dd1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938852.075488:0:35045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342583552 00000100:00100000:1.0:1784938852.075494:0:35045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342583552 00000100:00100000:1.0:1784938852.075536:0:35045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784938852.075544:0:35045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:35046:x1871643342583552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938852.075957:0:35045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:35046:x1871643342583552:12345-0@lo:502:llog_process_th.0 Request processed in 413us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938852.075965:0:35045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784938852.076017:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342583424:192.168.202.104@tcp:8:llog_process_th.0 00000100:00100000:2.0:1784938852.076255:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938852.076281:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342583424 00000100:00100000:2.0:1784938852.076286:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342583424 00000100:00100000:2.0:1784938852.076312:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 188 00000100:00100000:2.0:1784938852.076318:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:12801:x1871643342583424:12345-192.168.202.104@tcp:8:llog_process_th.0 00010000:00080000:2.0:1784938852.076343:0:31428:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 1005 last 0 00000020:00000080:2.0:1784938852.076370:0:31428:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd9d312a94a095b6 00002000:00100000:2.0:1784938852.076380:0:31428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9747360df000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1784938852.076385:0:31428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1784938852.076387:0:31428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784938852.076617:0:31428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784938852.076645:0:31428:0:(import.c:65:import_set_state_nolock()) ffff9747360da000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938852.076695:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:12801:x1871643342583424:12345-192.168.202.104@tcp:8:llog_process_th.0 Request processed in 375us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938852.076703:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 188 00000100:00100000:1.0:1784938852.076878:0:12801:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784938852.076887:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784938852.076894:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784938852.076899:0:12801:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784938852.076901:0:12801:0:(import.c:65:import_set_state_nolock()) ffff9747360dd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784938852.076915:0:12801:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784938852.076921:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:12801:1871643342583424:192.168.202.104@tcp:8:llog_process_th.0 00000100:00100000:1.0:1784938852.076984:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342583680:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938852.077091:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938852.077112:0:31430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342583680 00000100:00100000:1.0:1784938852.077116:0:31430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342583680 00000100:00100000:1.0:1784938852.077158:0:31430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 36 00000100:00100000:1.0:1784938852.077166:0:31430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:12804:x1871643342583680:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938852.077201:0:31430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 384827392 avail 382730240 00000100:00100000:1.0:1784938852.077233:0:31430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:12804:x1871643342583680:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 68us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938852.077241:0:31430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 36 00000100:00080000:1.0:1784938852.077259:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938852.077339:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342583680:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938852.077532:0:35046:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:35046:1871643342583552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938852.077571:0:35046:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938852.077579:0:35046:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938852.077581:0:35046:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784938852.077586:0:35046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:0.0:1784938852.077926:0:35052:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784938852.078095:0:35052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1005915342472ns, next at 0ns, rc = 0 00000020:01000000:1.0:1784938852.078168:0:35014:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-33 (rc=0) 10000000:01000000:1.0:1784938852.078197:0:35014:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784938852.078215:0:35014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97473ea04400/0xcd9d312a94a09531 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09538 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.078227:0:35014:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97473ea04400/0xcd9d312a94a09531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09538 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938852.078234:0:35014:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff974740e48800 from 1 10000000:01000000:1.0:1784938852.078237:0:35014:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938852.078270:0:35014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.078279:0:35014:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.078289:0:35014:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938852.078307:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603683100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342583808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938852.078350:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938852.078373:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718548b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938852.078441:0:35022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342583808 00000100:00100000:0.0:1784938852.078447:0:35022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342583808 00000100:00100000:0.0:1784938852.078484:0:35022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784938852.078491:0:35022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+8:35014:x1871643342583808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938852.078509:0:35022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938852.078524:0:35022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97473ea04000/0xcd9d312a94a095c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a095bd expref: -99 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.078548:0:35022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97473ea04000/0xcd9d312a94a095c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a095bd expref: 9 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.078558:0:35022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97473ea04000/0xcd9d312a94a095c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a095bd expref: 9 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.078568:0:35022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea04000, rc 0) 00000100:00100000:0.0:1784938852.078599:0:35022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:35014:x1871643342583808:12345-0@lo:101:mount.lustre.0 Request processed in 109us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938852.078606:0:35022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784938852.081531:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603683100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342583808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938852.081576:0:35014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a095c4 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.081592:0:35014:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a095c4 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938852.082154:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974603683100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342583936:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784938852.082221:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938852.082254:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff974718548b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938852.082867:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342583936 00000100:00100000:2.0:1784938852.082877:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342583936 00000100:00100000:2.0:1784938852.082937:0:35021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784938852.082946:0:35021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:35014:x1871643342583936:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784938852.082967:0:35021:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784938852.082986:0:35021:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784938852.082990:0:35021:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784938852.082993:0:35021:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 10 00000100:00100000:2.0:1784938852.083080:0:35021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:35014:x1871643342583936:12345-0@lo:256:mount.lustre.0 Request processed in 135us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938852.083088:0:35021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784938852.088910:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603683100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342583936:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1784938852.089509:0:35014:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784938852.089581:0:35014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a095c4 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.089594:0:35014:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a095c4 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938852.089604:0:35014:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff974740e48800 from 1 10000000:01000000:0.0:1784938852.089607:0:35014:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938852.089644:0:35014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97473ea05a00/0xcd9d312a94a095cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.089652:0:35014:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97473ea05a00/0xcd9d312a94a095cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.089686:0:35014:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97473ea05a00/0xcd9d312a94a095cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938852.089708:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342584064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938852.089802:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938852.089840:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff974707dd1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938852.089864:0:35022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342584064 00000100:00100000:0.0:1784938852.089870:0:35022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342584064 00000100:00100000:0.0:1784938852.089913:0:35022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784938852.089922:0:35022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+9:35014:x1871643342584064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938852.089935:0:35022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938852.089947:0:35022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97473ea05e00/0xcd9d312a94a095d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a095cb expref: -99 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.089970:0:35022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97473ea05e00/0xcd9d312a94a095d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a095cb expref: 10 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.089981:0:35022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97473ea05e00/0xcd9d312a94a095d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a095cb expref: 10 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.089989:0:35022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97473ea05e00, rc 0) 00000100:00100000:0.0:1784938852.090023:0:35022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:35014:x1871643342584064:12345-0@lo:101:mount.lustre.0 Request processed in 101us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938852.090030:0:35022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784938852.090068:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342584064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938852.090081:0:35014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97473ea05a00/0xcd9d312a94a095cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a095d2 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.090096:0:35014:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97473ea05a00/0xcd9d312a94a095cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a095d2 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938852.090144:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342584192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938852.090168:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938852.090182:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff974707dd1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938852.090918:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342584192 00000100:00100000:1.0:1784938852.090925:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342584192 00000100:00100000:1.0:1784938852.090957:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784938852.090964:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:35014:x1871643342584192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938852.091296:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:35014:x1871643342584192:12345-0@lo:501:mount.lustre.0 Request processed in 331us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938852.091304:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784938852.091614:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342584192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938852.091658:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342584320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938852.091713:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938852.091975:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff974707dd1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938852.092064:0:35022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342584320 00000100:00100000:1.0:1784938852.092069:0:35022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342584320 00000100:00100000:1.0:1784938852.092136:0:35022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784938852.092144:0:35022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:35014:x1871643342584320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938852.092313:0:35022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:35014:x1871643342584320:12345-0@lo:503:mount.lustre.0 Request processed in 168us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938852.092321:0:35022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784938852.092393:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342584320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938852.092619:0:35054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:35054:1871643342584448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938852.092655:0:35054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938852.093244:0:35054:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe61540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938852.093634:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342584448 00000100:00100000:2.0:1784938852.093642:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342584448 00000100:00100000:2.0:1784938852.093693:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784938852.093703:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:35054:x1871643342584448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938852.094396:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:35054:x1871643342584448:12345-0@lo:502:llog_process_th.0 Request processed in 693us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938852.094404:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784938852.094566:0:35054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:35054:1871643342584448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938852.094598:0:35054:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938852.094607:0:35054:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938852.094609:0:35054:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784938852.094616:0:35054:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff974740e48800 00000020:00000080:3.0:1784938852.094618:0:35054:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938852.094627:0:35054:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938852.094629:0:35054:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938852.094630:0:35054:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784938852.094633:0:35054:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938852.094635:0:35054:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938852.094636:0:35054:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784938852.094640:0:35054:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff974740e48800 00000020:00000080:3.0:1784938852.094642:0:35054:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784938852.094732:0:35054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:35054:1871643342584576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938852.094790:0:35054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938852.094813:0:35054:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe61540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938852.095649:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342584576 00000100:00100000:2.0:1784938852.095656:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342584576 00000100:00100000:2.0:1784938852.095702:0:35021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784938852.095711:0:35021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:35054:x1871643342584576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938852.095906:0:35021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:35054:x1871643342584576:12345-0@lo:502:llog_process_th.0 Request processed in 195us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938852.095914:0:35021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784938852.096456:0:35054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:35054:1871643342584576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938852.096495:0:35054:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938852.096503:0:35054:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938852.096505:0:35054:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784938852.096509:0:35054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784938852.096577:0:35014:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1784938852.096598:0:35014:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938852.096611:0:35014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97473ea05a00/0xcd9d312a94a095cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a095d2 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.096622:0:35014:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97473ea05a00/0xcd9d312a94a095cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a095d2 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938852.096665:0:35014:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784938852.096668:0:35014:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff974740e48800 10000000:01000000:3.0:1784938852.096671:0:35014:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff974740e48800 10000000:01000000:3.0:1784938852.096692:0:35014:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784938852.096698:0:35014:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff974740e48800 from 1 10000000:01000000:3.0:1784938852.096702:0:35014:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784938852.096731:0:35014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460209a800/0xcd9d312a94a095d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.100760:0:35014:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460209a800/0xcd9d312a94a095d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.100782:0:35014:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460209a800/0xcd9d312a94a095d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938852.100817:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342584704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938852.100899:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938852.100937:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe61a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938852.101725:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342584704 00000100:00100000:2.0:1784938852.101734:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342584704 00000100:00100000:2.0:1784938852.101808:0:35021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784938852.101817:0:35021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:35014:x1871643342584704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938852.101843:0:35021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938852.101863:0:35021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974709892400/0xcd9d312a94a095e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a095d9 expref: -99 pid: 35021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.101891:0:35021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974709892400/0xcd9d312a94a095e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a095d9 expref: 11 pid: 35021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.101902:0:35021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974709892400/0xcd9d312a94a095e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a095d9 expref: 11 pid: 35021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.101912:0:35021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892400, rc 0) 00000100:00100000:2.0:1784938852.101962:0:35021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:35014:x1871643342584704:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938852.101969:0:35021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784938852.102102:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342584704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938852.102118:0:35014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460209a800/0xcd9d312a94a095d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a095e0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.102128:0:35014:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460209a800/0xcd9d312a94a095d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a095e0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938852.102200:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342584832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938852.102230:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938852.102246:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe61a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938852.102261:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342584832 00000100:00100000:3.0:1784938852.102265:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342584832 00000100:00100000:3.0:1784938852.102291:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784938852.102297:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:35014:x1871643342584832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938852.102531:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:35014:x1871643342584832:12345-0@lo:501:mount.lustre.0 Request processed in 233us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938852.102539:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784938852.102572:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342584832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938852.102600:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342584960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938852.102636:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938852.102648:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe61a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938852.102660:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342584960 00000100:00100000:3.0:1784938852.102663:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342584960 00000100:00100000:3.0:1784938852.103118:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784938852.103127:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974739463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:35014:x1871643342584960:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938852.103284:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974739463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:35014:x1871643342584960:12345-0@lo:503:mount.lustre.0 Request processed in 158us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938852.103298:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784938852.103813:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342584960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938852.111492:0:35057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:35057:1871643342585088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938852.112888:0:35057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938852.112929:0:35045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342585088 00000100:00100000:3.0:1784938852.112937:0:35045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342585088 00000100:00100000:3.0:1784938852.112980:0:35045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784938852.112989:0:35045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974713799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:35057:x1871643342585088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938852.113219:0:35045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974713799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:35057:x1871643342585088:12345-0@lo:502:llog_process_th.0 Request processed in 229us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938852.113228:0:35045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784938852.113277:0:35057:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704006c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938852.113300:0:35057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:35057:1871643342585088:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1784938852.113359:0:35057:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1784938852.113374:0:35057:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff974609e8cd40) 00000020:00000080:3.0:1784938852.113397:0:35057:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1784938852.113584:0:35057:0:(tgt_mount.c:153:server_get_mount()) get mount ffff974740e48800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784938852.113589:0:35057:0:(tgt_mount.c:187:server_put_mount()) put mount ffff974740e48800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784938852.113592:0:35057:0:(obd_mount.c:706:lustre_put_lsi()) put ffff974740e48800 4 00010000:00080000:3.0:1784938852.113623:0:35057:0:(ldlm_lib.c:125:import_set_conn()) imp ffff97471da1c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:3.0:1784938852.118400:0:35057:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-5 is initialized 00000020:00000080:3.0:1784938852.118517:0:35057:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784938852.118555:0:35057:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784938852.118569:0:35057:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcd9d312a94a095ee 00000100:00080000:3.0:1784938852.118583:0:35057:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 192.168.202.104@tcp last attempt 0 00000100:00080000:3.0:1784938852.118595:0:35057:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97471da1c800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:3.0:1784938852.118635:0:35057:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974602fb5880 x1871643342585216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938852.118876:0:35057:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784938852.121215:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342585216:192.168.202.104@tcp:38:llog_process_th.0 00000100:00100000:1.0:1784938852.121501:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938852.121547:0:35028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342585216 00000100:00100000:1.0:1784938852.121555:0:35028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342585216 00000100:00100000:1.0:1784938852.121594:0:35028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00100000:1.0:1784938852.121602:0:35028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12801:x1871643342585216:12345-192.168.202.104@tcp:38:llog_process_th.0 00000100:00100000:1.0:1784938852.121655:0:35028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:12801:x1871643342585216:12345-192.168.202.104@tcp:38:llog_process_th.0 Request processed in 52us (155us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784938852.121663:0:35028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00100000:1.0:1784938852.122272:0:12801:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784938852.122281:0:12801:0:(import.c:65:import_set_state_nolock()) ffff97471da1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938852.122287:0:12801:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.104@tcp failed (-11) 00000100:00100000:1.0:1784938852.122291:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342585216:192.168.202.104@tcp:38:llog_process_th.0 00000100:00100000:3.0:1784938852.133402:0:35057:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:35057:1871643342585344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938852.133489:0:35057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938852.133530:0:35022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342585344 00000100:00100000:3.0:1784938852.133536:0:35022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342585344 00000100:00100000:3.0:1784938852.133578:0:35022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784938852.133587:0:35022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974713798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:35057:x1871643342585344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938852.133878:0:35022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974713798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:35057:x1871643342585344:12345-0@lo:502:llog_process_th.0 Request processed in 290us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938852.133888:0:35022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784938852.133939:0:35057:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704006c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938852.133960:0:35057:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754ce9ff-680f-4784-b8fd-fa933d4638f3:35057:1871643342585344:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784938852.133984:0:35057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1784938852.134041:0:35014:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1784938852.134059:0:35014:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784938852.134073:0:35014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460209a800/0xcd9d312a94a095d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a095e0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.134084:0:35014:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460209a800/0xcd9d312a94a095d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a095e0 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784938852.134128:0:35014:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784938852.134130:0:35014:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784938852.134132:0:35014:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938852.134133:0:35014:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938852.134135:0:35014:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938852.134136:0:35014:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938852.134141:0:35014:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938852.134143:0:35014:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784938852.134145:0:35014:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938852.134147:0:35014:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784938852.134151:0:35014:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1784938852.134153:0:35014:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784938852.134154:0:35014:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784938852.134155:0:35014:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938852.134156:0:35014:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938852.134157:0:35014:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938852.134159:0:35014:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938852.134159:0:35014:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938852.134161:0:35014:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784938852.134162:0:35014:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938852.134163:0:35014:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784938852.134177:0:35014:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784938852.134186:0:35014:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342585472:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784938852.134215:0:35014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938852.134228:0:35014:0:(client.c:2702:ptlrpc_set_wait()) set ffff974704006c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938852.134248:0:35045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342585472 00000100:00100000:3.0:1784938852.134252:0:35045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342585472 00000100:00100000:3.0:1784938852.134274:0:35045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784938852.134280:0:35045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974721540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:35014:x1871643342585472:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784938852.134299:0:35045:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784938852.134314:0:35045:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000004:00080000:1.0:1784938852.142697:0:35037:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1784938852.167965:0:35037:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 20000000:01000000:1.0:1784938852.192447:0:35045:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784938852.192469:0:35045:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784938852.192594:0:35023:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784938852.192599:0:35023:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784938852.192622:0:35023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.192640:0:35023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97473ea04000/0xcd9d312a94a095c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a095bd expref: 11 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.192648:0:35023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.192699:0:35023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97473ea04000/0xcd9d312a94a095c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd9d312a94a095bd expref: 11 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.192715:0:35023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97473ea04000/0xcd9d312a94a095c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd9d312a94a095bd expref: 11 pid: 35022 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938852.192786:0:35023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35023:1871643342585600:0@lo:104: 00000100:00100000:0.0:1784938852.192854:0:35023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938852.192897:0:35023:0:(client.c:2702:ptlrpc_set_wait()) set ffff97470507d240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938852.195031:0:30614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342585600 00000100:00100000:2.0:1784938852.195046:0:30614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342585600 00000100:00100000:2.0:1784938852.195099:0:30614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784938852.195107:0:30614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:35023:x1871643342585600:12345-0@lo:104: 00010000:00010000:2.0:1784938852.195131:0:30614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a095c4 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195218:0:30614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938852.195224:0:30614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754ce9ff-680f-4784-b8fd-fa933d4638f3+3:35023:x1871643342585600:12345-0@lo:104: Request processed in 119us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938852.195231:0:30614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1784938852.195252:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938852.195259:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd9d312a94a095c4 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195288:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a800 already unused, calling callback (ffffffffc1a4fc20) 10000000:00010000:2.0:1784938852.195293:0:30619:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd9d312a94a095c4 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195301:0:30619:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd9d312a94a095c4 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938852.195308:0:30619:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd9d312a94a095c4 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938852.195314:0:30619:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938852.195355:0:30619:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a095c4 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195362:0:30619:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938852.195380:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a095c4 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195386:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97460290a800/0xcd9d312a94a095bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd9d312a94a095c4 expref: -99 pid: 35014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195405:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.195407:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.195409:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938852.195468:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342585728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938852.195512:0:12805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938852.195598:0:35023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35023:1871643342585600:0@lo:104: 00010000:00010000:1.0:1784938852.195621:0:35023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938852.195700:0:30617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342585728 00000100:00100000:2.0:1784938852.195705:0:30617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342585728 00010000:00010000:2.0:1784938852.195724:0:30617:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97473ea04000/0xcd9d312a94a095c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a095bd expref: 12 pid: 35022 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938852.195836:0:30617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784938852.195851:0:30617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603681880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:12805:x1871643342585728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938852.195864:0:30617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938852.195870:0:30617:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97473ea04000/0xcd9d312a94a095c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd9d312a94a095bd expref: 12 pid: 35022 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195883:0:30617:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97473ea04000/0xcd9d312a94a095c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd9d312a94a095bd expref: 12 pid: 35022 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195899:0:30617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97473ea04000/0xcd9d312a94a095c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd9d312a94a095bd expref: 12 pid: 35022 timeout: 1106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195915:0:30617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195927:0:30617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784938852.195944:0:30617:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003346043s 00010000:00010000:2.0:1784938852.195949:0:30617:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195957:0:30617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195965:0:30617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195972:0:30617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195978:0:30617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938852.195988:0:30617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.195996:0:30617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.196010:0:30617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.196020:0:30617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938852.196049:0:30617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603681880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:12805:x1871643342585728:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938852.196056:0:30617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784938852.196544:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754ce9ff-680f-4784-b8fd-fa933d4638f3:12805:1871643342585728:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938852.196569:0:35023:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.196577:0:35023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.196596:0:35023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97473ea05800/0xcd9d312a94a095f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938852.202253:0:35045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974721540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:35014:x1871643342585472:12345-0@lo:253:mount.lustre.0 Request processed in 67958us (68023us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938852.202269:0:35045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784938852.202372:0:35014:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754ce9ff-680f-4784-b8fd-fa933d4638f3:35014:1871643342585472:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784938852.202390:0:35014:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784938852.202394:0:35014:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784938852.202396:0:35014:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784938852.202397:0:35014:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938852.202398:0:35014:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938852.202400:0:35014:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938852.202401:0:35014:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938852.202424:0:35014:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938852.202426:0:35014:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784938852.202428:0:35014:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938852.202429:0:35014:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784938852.202448:0:35014:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784938852.203387:0:35014:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938852.203557:0:35014:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784938852.203973:0:35014:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938852.204132:0:35014:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784938852.204408:0:35014:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938852.204564:0:35014:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1784938852.205580:0:35014:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1784938852.205909:0:35014:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1784938852.206188:0:35014:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1784938852.206410:0:35014:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1784938852.206662:0:35014:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1784938852.207031:0:35014:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:0.0:1784938852.236079:0:35014:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784938852.236253:0:35062:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1784938852.236257:0:35062:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1784938852.239653:0:35063:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1784938852.241140:0:35063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938852.243269:0:35063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784938852.243357:0:35063:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784938852.243362:0:35063:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1784938852.246828:0:35014:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1784938852.247011:0:35014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1784938852.247663:0:35014:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784938852.247685:0:35014:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784938852.248092:0:35014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938852.250255:0:35014:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784938852.251562:0:35014:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784938852.251610:0:35014:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1784938852.252157:0:35014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1784938852.253257:0:35014:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:3.0:1784938852.260312:0:35014:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1784938852.291561:0:35014:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784938852.291602:0:35014:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa2eec0da3988 00100000:10000000:3.0:1784938852.291614:0:35014:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1784938852.293218:0:35014:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784938852.293240:0:35014:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784938852.293256:0:35014:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1784938852.293285:0:35014:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000004:00080000:2.0:1784938852.297291:0:35053:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x28:0x0] 00000100:00100000:2.0:1784938852.297349:0:35053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35053:1871643342585856:192.168.202.104@tcp:5:osp-pre-1-0.0 00000100:00100000:2.0:1784938852.297464:0:35053:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472a0cae40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938852.297798:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938852.297828:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342585856 00000100:00100000:1.0:1784938852.297835:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342585856 00000100:00100000:1.0:1784938852.297882:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 189 00000100:00100000:1.0:1784938852.297891:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974603683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:35053:x1871643342585856:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1784938852.297919:0:31427:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 97 -> diff = -57 00002000:02000040:1.0:1784938852.297923:0:31427:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:41 to 0x280000400:97) 00000004:00080000:0.0:1784938852.303605:0:35051:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x29:0x0] 00000100:00100000:0.0:1784938852.303687:0:35051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:35051:1871643342585984:192.168.202.104@tcp:5:osp-pre-0-0.0 00000100:00100000:0.0:1784938852.303841:0:35051:0:(client.c:2702:ptlrpc_set_wait()) set ffff974603695540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938852.316306:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938852.316337:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342585984 00000100:00100000:1.0:1784938852.316346:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342585984 00000100:00100000:1.0:1784938852.316390:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 190 00000100:00100000:1.0:1784938852.316400:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:35051:x1871643342585984:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1784938852.316432:0:31428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 97 -> diff = -56 00002000:02000040:1.0:1784938852.316436:0:31428:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:42 to 0x240000400:97) 00002000:00010000:2.0:1784938852.321856:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938852.321879:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a095fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.321897:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:2.0:1784938852.321902:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938852.321910:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a095fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.321928:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a095fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.321939:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a095fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.321948:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a095fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.321968:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938852.321983:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938852.321988:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a095fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.321996:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938852.322001:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a095fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322010:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a095fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322038:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a095fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322046:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067c14333/0xcd9d312a94a095fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322065:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.322067:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.322069:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938852.322624:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938852.322631:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09603 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322641:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:2.0:1784938852.322644:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938852.322649:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09603 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322659:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09603 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322666:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09603 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322688:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322719:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938852.322732:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938852.322737:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322745:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938852.322749:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322783:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09603 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322798:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09603 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322805:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e999b0ab/0xcd9d312a94a09603 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.322820:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.322822:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.322823:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938852.323124:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938852.323131:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0960a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.323139:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:2.0:1784938852.323148:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938852.323152:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0960a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.323162:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0960a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.323171:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0960a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.323179:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0960a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.323193:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938852.323203:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938852.323208:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0960a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.323216:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938852.323220:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0960a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.323229:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0960a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.323240:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0960a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.323260:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005349e6ee/0xcd9d312a94a0960a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.323275:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.323277:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.323279:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938852.328922:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.328937:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a09611 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.328956:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.328961:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.328968:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a09611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.328984:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a09611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.329010:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a09611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.329020:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a09611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.329039:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938852.329486:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.329493:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a09618 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.329502:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.329505:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.329509:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a09618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.329520:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a09618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.329528:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a09618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.329537:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a09618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.329572:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784938852.329931:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.329937:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046a76218/0xcd9d312a94a0961f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.329946:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5c:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.329950:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.329954:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046a76218/0xcd9d312a94a0961f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.329963:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046a76218/0xcd9d312a94a0961f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.329971:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046a76218/0xcd9d312a94a0961f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.329979:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046a76218/0xcd9d312a94a0961f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.329998:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784938852.330288:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.330294:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a09626 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.330303:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5b:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.330312:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.330316:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a09626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.330325:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a09626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.330333:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a09626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.330339:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a09626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.330346:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1784938852.330634:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.330640:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024377eac/0xcd9d312a94a0962d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.330648:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5a:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.330650:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.330654:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024377eac/0xcd9d312a94a0962d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.330664:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024377eac/0xcd9d312a94a0962d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.330685:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024377eac/0xcd9d312a94a0962d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.330700:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024377eac/0xcd9d312a94a0962d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.330708:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1784938852.330995:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.331001:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ed80bb2/0xcd9d312a94a09634 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.331010:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x59:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.331012:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.331017:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ed80bb2/0xcd9d312a94a09634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.331026:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ed80bb2/0xcd9d312a94a09634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.331035:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ed80bb2/0xcd9d312a94a09634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.331043:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ed80bb2/0xcd9d312a94a09634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.331049:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1784938852.332543:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.332553:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a0963b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.332572:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x58:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.332576:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.332583:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a0963b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.332594:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a0963b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.332602:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a0963b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.332609:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a0963b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.332617:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1784938852.333001:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.333006:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a09642 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.333013:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x57:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.333016:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.333020:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a09642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.333029:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a09642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.333049:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a09642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.333055:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a09642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.333063:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1784938852.335909:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1784938852.335926:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a09611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.335940:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.335945:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a09611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.335976:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a09611 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.335997:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a09611 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336005:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d0859cf/0xcd9d312a94a09611 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336034:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1784938852.336039:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a09618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336045:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.336048:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a09618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336055:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a09618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336064:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a09618 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336069:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3b16d9a/0xcd9d312a94a09618 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336092:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784938852.336096:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046a76218/0xcd9d312a94a0961f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336102:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.336104:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046a76218/0xcd9d312a94a0961f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336111:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046a76218/0xcd9d312a94a0961f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336120:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046a76218/0xcd9d312a94a0961f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336128:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046a76218/0xcd9d312a94a0961f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336139:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784938852.336142:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a09626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336147:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.336149:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a09626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336165:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a09626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336174:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a09626 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336180:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000867ca0ae/0xcd9d312a94a09626 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336192:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784938852.336195:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024377eac/0xcd9d312a94a0962d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336200:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.336202:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024377eac/0xcd9d312a94a0962d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336208:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024377eac/0xcd9d312a94a0962d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336215:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024377eac/0xcd9d312a94a0962d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336220:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024377eac/0xcd9d312a94a0962d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336239:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938852.336242:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ed80bb2/0xcd9d312a94a09634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336247:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.336250:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ed80bb2/0xcd9d312a94a09634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336256:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ed80bb2/0xcd9d312a94a09634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336264:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ed80bb2/0xcd9d312a94a09634 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336269:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ed80bb2/0xcd9d312a94a09634 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336279:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938852.336282:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a0963b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336288:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.336290:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a0963b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336306:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a0963b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336316:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a0963b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336322:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa4469e8/0xcd9d312a94a0963b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336336:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938852.336339:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a09642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336345:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.336348:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a09642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336356:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a09642 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336365:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a09642 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336372:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001be8c486/0xcd9d312a94a09642 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.336396:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.336398:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.336399:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938852.337429:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.337452:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a09649 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.337467:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x56:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.337471:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.337478:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a09649 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.337494:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a09649 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.337503:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a09649 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.337511:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a09649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.337550:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938852.337993:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.338000:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000525f600e/0xcd9d312a94a09650 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338009:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x55:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.338013:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.338018:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000525f600e/0xcd9d312a94a09650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338027:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000525f600e/0xcd9d312a94a09650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338036:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000525f600e/0xcd9d312a94a09650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338044:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000525f600e/0xcd9d312a94a09650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338052:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784938852.338369:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.338375:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a09657 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338383:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x54:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.338391:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.338396:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a09657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338405:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a09657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338414:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a09657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338421:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a09657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338430:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784938852.338599:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938852.338606:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a09649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338615:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.338620:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a09649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338629:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a09649 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338645:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a09649 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338652:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fc87998/0xcd9d312a94a09649 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338683:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938852.338687:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000525f600e/0xcd9d312a94a09650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338702:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.338712:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000525f600e/0xcd9d312a94a09650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338720:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000525f600e/0xcd9d312a94a09650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338730:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000525f600e/0xcd9d312a94a09650 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938852.338731:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.338736:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0965e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338744:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x53:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.338747:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.338770:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0965e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338781:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0965e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338790:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0965e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338803:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0965e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.338811:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938852.338880:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000525f600e/0xcd9d312a94a09650 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338895:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938852.338899:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a09657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338905:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea04000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.338908:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a09657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338916:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a09657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338926:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a09657 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338933:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb117960/0xcd9d312a94a09657 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338951:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938852.338954:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0965e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338961:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97473ea05800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.338964:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0965e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338972:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0965e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338982:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0965e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.338989:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf472bd9/0xcd9d312a94a0965e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.339001:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.339002:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.339004:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938852.339115:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.339121:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a09665 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.339128:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x52:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.339131:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.339135:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a09665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.339143:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a09665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.339151:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a09665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.339157:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a09665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.339181:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938852.339331:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938852.339338:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a09665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.339345:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938852.339349:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a09665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.339356:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a09665 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.339368:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a09665 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.339375:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005411a22d/0xcd9d312a94a09665 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.339391:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.339392:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.339394:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.339406:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938852.339456:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.339462:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca410adc/0xcd9d312a94a0966c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.339474:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.339477:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.339481:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca410adc/0xcd9d312a94a0966c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.339491:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca410adc/0xcd9d312a94a0966c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.340872:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.344411:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.344424:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a09673 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.344443:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x61:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.344457:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.344465:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a09673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.345226:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca410adc/0xcd9d312a94a0966c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.345235:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca410adc/0xcd9d312a94a0966c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.345273:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938852.345286:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938852.345293:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca410adc/0xcd9d312a94a0966c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.345301:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938852.345306:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca410adc/0xcd9d312a94a0966c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.345315:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca410adc/0xcd9d312a94a0966c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.345335:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca410adc/0xcd9d312a94a0966c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.345341:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca410adc/0xcd9d312a94a0966c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.345361:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.345362:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.345364:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.345569:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a09673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.345579:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a09673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.345587:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a09673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938852.346111:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.346118:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a0967a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.346129:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.346133:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.346139:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a0967a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.346148:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a0967a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.346166:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a0967a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.346174:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a0967a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.346195:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938852.346208:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938852.346215:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a0967a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.346222:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938852.346226:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a0967a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.346246:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a0967a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.346258:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a0967a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.346265:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca37bb73/0xcd9d312a94a0967a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.346279:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.346280:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.346282:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938852.347531:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.347543:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a09681 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.347558:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.347562:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.347567:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a09681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.347579:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a09681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.347589:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a09681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.347597:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a09681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.347624:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938852.348132:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784938852.348146:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938852.348153:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a09681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.348163:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.348167:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a09681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.348176:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a09681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.348191:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a09681 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.348210:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb5e15fb/0xcd9d312a94a09681 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.348226:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.348231:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a09673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.348237:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290ae00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.348241:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a09673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.348249:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a09673 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.348260:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a09673 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.348268:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a09673 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.348281:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.348283:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.348284:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938852.349135:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.349145:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a09688 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.349160:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.349164:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.349170:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a09688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.349182:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a09688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.349192:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a09688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.349199:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a09688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.349224:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938852.349233:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938852.349240:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a09688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.349249:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938852.349252:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a09688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.349260:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a09688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.349275:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a09688 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.349294:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b29bdd2/0xcd9d312a94a09688 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.349310:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.349313:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.349314:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.351040:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.351051:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a0968f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.351076:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x60:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.351081:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.351086:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a0968f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.351100:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a0968f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.351109:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a0968f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.351116:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a0968f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.351136:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938852.351147:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.351152:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a0968f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.351159:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290bc00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.351163:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a0968f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.351170:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a0968f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.351195:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a0968f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.351203:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a0968f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.351222:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.351225:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.351227:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938852.352023:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.352032:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a09696 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.352045:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.352055:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.352061:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a09696 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.352073:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a09696 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.352081:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a09696 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.352089:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a09696 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.352112:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938852.352125:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938852.352131:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a09696 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.352139:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938852.352143:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a09696 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.352152:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a09696 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.352166:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a09696 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.352173:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac643eff/0xcd9d312a94a09696 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.352190:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.352191:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.352192:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938852.352430:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.352436:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000641e7057/0xcd9d312a94a0969d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.352446:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.352449:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.352453:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000641e7057/0xcd9d312a94a0969d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.352463:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000641e7057/0xcd9d312a94a0969d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.352471:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000641e7057/0xcd9d312a94a0969d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.352484:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000641e7057/0xcd9d312a94a0969d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.352499:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938852.353917:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938852.353928:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000641e7057/0xcd9d312a94a0969d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.353940:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.353955:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000641e7057/0xcd9d312a94a0969d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.353963:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000641e7057/0xcd9d312a94a0969d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.353981:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000641e7057/0xcd9d312a94a0969d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.353988:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000641e7057/0xcd9d312a94a0969d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.354012:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.354014:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.354016:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.354103:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.354249:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.354256:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f653177/0xcd9d312a94a096a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.354269:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5f:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.354272:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.354279:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f653177/0xcd9d312a94a096a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.354292:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f653177/0xcd9d312a94a096a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.354302:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f653177/0xcd9d312a94a096a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.354310:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f653177/0xcd9d312a94a096a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.354347:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938852.354571:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938852.354577:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f653177/0xcd9d312a94a096a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.354585:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.354589:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f653177/0xcd9d312a94a096a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.354597:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f653177/0xcd9d312a94a096a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.354608:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f653177/0xcd9d312a94a096a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.354622:0:30618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f653177/0xcd9d312a94a096a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.354639:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.354640:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.354642:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.355127:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.355134:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004052f7be/0xcd9d312a94a096ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.355144:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5e:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.355148:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.355153:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004052f7be/0xcd9d312a94a096ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.355163:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004052f7be/0xcd9d312a94a096ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.355171:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004052f7be/0xcd9d312a94a096ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.355178:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004052f7be/0xcd9d312a94a096ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.355195:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938852.355454:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.355460:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4cd6b27/0xcd9d312a94a096b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.355468:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5d:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:3.0:1784938852.356428:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938852.356439:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004052f7be/0xcd9d312a94a096ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.356451:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290aa00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.356455:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004052f7be/0xcd9d312a94a096ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.356465:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004052f7be/0xcd9d312a94a096ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.356564:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004052f7be/0xcd9d312a94a096ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.356571:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004052f7be/0xcd9d312a94a096ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.356589:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.356591:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.356593:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.357116:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.357127:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4cd6b27/0xcd9d312a94a096b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.357143:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4cd6b27/0xcd9d312a94a096b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.357155:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4cd6b27/0xcd9d312a94a096b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.357163:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4cd6b27/0xcd9d312a94a096b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.357182:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938852.357199:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.357203:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4cd6b27/0xcd9d312a94a096b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.357211:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.357215:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4cd6b27/0xcd9d312a94a096b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.357223:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4cd6b27/0xcd9d312a94a096b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.357234:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4cd6b27/0xcd9d312a94a096b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.357256:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4cd6b27/0xcd9d312a94a096b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.357272:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.357274:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.357276:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.357959:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.357969:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a096b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.357984:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5c:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.357989:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.357994:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a096b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358005:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a096b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358013:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a096b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358020:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a096b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358043:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938852.358345:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.358358:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a096c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358367:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5b:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.358370:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.358374:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a096c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358383:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a096c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358390:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a096c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358397:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a096c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358414:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784938852.358735:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.358741:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf99c538/0xcd9d312a94a096c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358748:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5a:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.358778:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.358782:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf99c538/0xcd9d312a94a096c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358792:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf99c538/0xcd9d312a94a096c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358807:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf99c538/0xcd9d312a94a096c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358815:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf99c538/0xcd9d312a94a096c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358829:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784938852.358845:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938852.358850:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a096b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358858:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.358862:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a096b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358870:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a096b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358886:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a096b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358894:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f3145e7/0xcd9d312a94a096b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358914:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938852.358923:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a096c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358930:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.358933:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a096c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358941:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a096c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358952:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a096c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358958:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e41d6a/0xcd9d312a94a096c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358971:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.358975:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf99c538/0xcd9d312a94a096c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358981:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.358983:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf99c538/0xcd9d312a94a096c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.358990:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf99c538/0xcd9d312a94a096c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359010:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf99c538/0xcd9d312a94a096c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359017:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf99c538/0xcd9d312a94a096c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359028:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.359029:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.359031:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.359344:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.359351:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a41c2162/0xcd9d312a94a096ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359360:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x59:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.359363:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.359367:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a41c2162/0xcd9d312a94a096ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359377:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a41c2162/0xcd9d312a94a096ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359385:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a41c2162/0xcd9d312a94a096ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359392:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a41c2162/0xcd9d312a94a096ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359419:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938852.359428:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.359432:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a41c2162/0xcd9d312a94a096ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359439:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290b000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.359443:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a41c2162/0xcd9d312a94a096ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359450:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a41c2162/0xcd9d312a94a096ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359461:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a41c2162/0xcd9d312a94a096ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359469:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a41c2162/0xcd9d312a94a096ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359483:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.359485:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.359487:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.359890:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.359897:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a096d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359906:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x58:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.359916:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.359921:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a096d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359931:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a096d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359940:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a096d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359948:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a096d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359963:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938852.359972:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.359976:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a096d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359983:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290ac00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.359986:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a096d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.359994:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a096d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.360005:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a096d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.360024:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a498e7fb/0xcd9d312a94a096d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.360039:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.360041:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.360042:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938852.360967:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.362153:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.362164:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a096dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.362179:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x57:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.362183:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.362189:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a096dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.362203:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a096dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.362212:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a096dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.362218:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a096dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.362234:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938852.362244:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.362256:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a096dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.362264:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290ba00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.362268:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a096dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.362276:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a096dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.362292:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a096dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.362300:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068c5f574/0xcd9d312a94a096dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.362320:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.362321:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.362323:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938852.362574:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.362580:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a096e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.362589:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.362591:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.362595:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a096e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.362603:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a096e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.362611:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a096e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.362617:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a096e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.362632:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938852.362962:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.362968:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a096ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.362981:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.362984:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.362988:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a096ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.362997:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a096ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.363004:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a096ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.363011:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a096ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.363029:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784938852.363282:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.363288:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c7a2c38/0xcd9d312a94a096f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.363295:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.363298:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.363302:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c7a2c38/0xcd9d312a94a096f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.363311:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c7a2c38/0xcd9d312a94a096f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.363330:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c7a2c38/0xcd9d312a94a096f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.363337:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c7a2c38/0xcd9d312a94a096f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.363344:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784938852.364492:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938852.364504:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a096f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.364515:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:0.0:1784938852.364518:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938852.364523:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a096f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.364535:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a096f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.364544:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a096f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.364551:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a096f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938852.364573:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1784938852.364580:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784938852.364587:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a096e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.364595:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.364599:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a096e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.364619:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a096e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.364634:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a096e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.364642:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000689e5ddf/0xcd9d312a94a096e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.364658:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938852.364662:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a096ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.364668:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609397200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.364681:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a096ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.364689:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a096ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.364697:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a096ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.364704:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004209fb33/0xcd9d312a94a096ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.364729:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938852.364733:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c7a2c38/0xcd9d312a94a096f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.364987:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938852.364993:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a096f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.365000:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.365003:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a096f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.365010:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a096f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.365021:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a096f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.365028:0:30619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bf5cb55/0xcd9d312a94a096f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.365042:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.365044:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.365046:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.365092:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974609396c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.365095:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c7a2c38/0xcd9d312a94a096f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.365103:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c7a2c38/0xcd9d312a94a096f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.365113:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c7a2c38/0xcd9d312a94a096f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.365121:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c7a2c38/0xcd9d312a94a096f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.365133:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.365134:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.365135:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.365410:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.365416:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a096ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.365425:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x56:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.365434:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.365439:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a096ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.365449:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a096ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.365458:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a096ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.365464:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a096ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.365561:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938852.366870:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.366880:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a09706 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.366895:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x55:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.366898:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.366903:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a09706 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.366915:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a09706 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.366924:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a09706 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.366941:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a09706 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.366958:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784938852.366970:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938852.366975:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a096ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.366983:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290be00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.366987:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a096ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.366995:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a096ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.367010:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a096ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.367017:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087cfdd25/0xcd9d312a94a096ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.367032:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.367035:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a09706 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.367053:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290bc00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.367056:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a09706 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.367063:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a09706 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.367073:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a09706 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.367080:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d90eb3c2/0xcd9d312a94a09706 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.367091:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.367093:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.367095:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.367296:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.367867:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.368886:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.368897:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a0970d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.368911:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x54:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.368916:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.368922:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a0970d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.368935:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a0970d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.368954:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a0970d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.368962:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a0970d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.368978:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938852.368989:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.368994:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a0970d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.369003:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290ae00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.369006:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a0970d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.369015:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a0970d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.369031:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a0970d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.369039:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd791a20/0xcd9d312a94a0970d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.369055:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.369062:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.369065:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.369386:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.369393:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8113ba9/0xcd9d312a94a09714 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.369401:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x53:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.369404:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.369409:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8113ba9/0xcd9d312a94a09714 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.369419:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8113ba9/0xcd9d312a94a09714 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.369427:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8113ba9/0xcd9d312a94a09714 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.369434:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8113ba9/0xcd9d312a94a09714 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.369451:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938852.371065:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.371077:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c237ea9a/0xcd9d312a94a0971b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371091:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x52:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.371094:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.371099:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c237ea9a/0xcd9d312a94a0971b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371117:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c237ea9a/0xcd9d312a94a0971b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371127:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c237ea9a/0xcd9d312a94a0971b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371135:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c237ea9a/0xcd9d312a94a0971b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371151:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784938852.371829:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.371837:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a09722 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371846:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.371850:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.371855:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a09722 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371865:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a09722 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371873:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a09722 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371894:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a09722 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371910:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784938852.371923:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938852.371929:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8113ba9/0xcd9d312a94a09714 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371937:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.371941:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8113ba9/0xcd9d312a94a09714 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371950:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8113ba9/0xcd9d312a94a09714 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371967:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8113ba9/0xcd9d312a94a09714 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371974:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8113ba9/0xcd9d312a94a09714 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.371992:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938852.371996:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c237ea9a/0xcd9d312a94a0971b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372014:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.372017:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c237ea9a/0xcd9d312a94a0971b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372025:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c237ea9a/0xcd9d312a94a0971b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372035:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c237ea9a/0xcd9d312a94a0971b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372042:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c237ea9a/0xcd9d312a94a0971b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372055:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.372058:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a09722 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372064:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460290a000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.372067:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a09722 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372073:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a09722 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372082:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a09722 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372095:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9fde26b/0xcd9d312a94a09722 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372108:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.372109:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.372111:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.372640:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.372648:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd63d40b/0xcd9d312a94a09729 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372659:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.372662:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.372667:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd63d40b/0xcd9d312a94a09729 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372690:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd63d40b/0xcd9d312a94a09729 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372883:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd63d40b/0xcd9d312a94a09729 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372891:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd63d40b/0xcd9d312a94a09729 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372908:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938852.372917:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.372928:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd63d40b/0xcd9d312a94a09729 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372934:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.372938:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd63d40b/0xcd9d312a94a09729 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372946:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd63d40b/0xcd9d312a94a09729 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372961:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd63d40b/0xcd9d312a94a09729 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372968:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd63d40b/0xcd9d312a94a09729 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.372981:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.372983:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.372985:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.373297:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.373304:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a09730 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.373312:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.373316:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.373320:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a09730 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.373340:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a09730 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.373348:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a09730 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.373355:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a09730 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.373369:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938852.373377:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.373381:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a09730 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.373387:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.373390:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a09730 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.373398:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a09730 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.373408:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a09730 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.373415:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc46195c/0xcd9d312a94a09730 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.373434:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.373436:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.373438:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.374076:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.374083:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001effa888/0xcd9d312a94a09737 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.374093:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.374096:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.374100:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001effa888/0xcd9d312a94a09737 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.374109:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001effa888/0xcd9d312a94a09737 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.374117:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001effa888/0xcd9d312a94a09737 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.374124:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001effa888/0xcd9d312a94a09737 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.374200:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938852.374211:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.374216:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001effa888/0xcd9d312a94a09737 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.374236:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00c00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.374240:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001effa888/0xcd9d312a94a09737 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.374248:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001effa888/0xcd9d312a94a09737 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.374262:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001effa888/0xcd9d312a94a09737 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.374269:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001effa888/0xcd9d312a94a09737 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.374284:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.374285:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.374287:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.374607:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.374613:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938852.375252:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938852.375261:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a0973e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.375284:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:3.0:1784938852.375287:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938852.375293:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a0973e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.375307:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a0973e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.375316:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a0973e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.375323:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a0973e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.375347:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784938852.375706:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938852.375713:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a09745 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.375722:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:3.0:1784938852.375726:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938852.375730:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a09745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.375773:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a09745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.375795:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a09745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.375803:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a09745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.375817:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784938852.376099:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938852.376106:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0974c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376115:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:3.0:1784938852.376118:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938852.376122:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0974c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376131:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0974c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376140:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0974c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376146:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0974c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376171:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784938852.376475:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938852.376481:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a09753 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376490:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:3.0:1784938852.376493:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938852.376497:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a09753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376507:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a09753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376515:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a09753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376522:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a09753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376530:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784938852.376911:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938852.376915:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067e9ee13/0xcd9d312a94a0975a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376921:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:3.0:1784938852.376927:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938852.376930:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067e9ee13/0xcd9d312a94a0975a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376937:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067e9ee13/0xcd9d312a94a0975a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376942:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067e9ee13/0xcd9d312a94a0975a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376946:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067e9ee13/0xcd9d312a94a0975a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.376951:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1784938852.377173:0:31427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938852.377177:0:31427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a09761 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.377182:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:3.0:1784938852.377184:0:31427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938852.377186:0:31427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a09761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.377192:0:31427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a09761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.377197:0:31427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a09761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.377206:0:31427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a09761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.377210:0:31427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1784938852.377883:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1784938852.377892:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a0973e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.377900:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209ba00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.377904:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a0973e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.377914:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a0973e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.377942:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a0973e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.377950:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf55230d/0xcd9d312a94a0973e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.377967:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1784938852.377970:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a09745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.377976:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.377979:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a09745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.377985:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a09745 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.377994:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a09745 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378002:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033753a40/0xcd9d312a94a09745 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378012:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784938852.378016:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0974c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378029:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209a400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.378032:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0974c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378039:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0974c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378048:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0974c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378054:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058b81ed2/0xcd9d312a94a0974c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378065:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938852.378068:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a09753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378074:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209b200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.378077:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a09753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378085:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a09753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378094:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a09753 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378107:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001760d2e/0xcd9d312a94a09753 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378120:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938852.378124:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067e9ee13/0xcd9d312a94a0975a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378130:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209b800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.378133:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067e9ee13/0xcd9d312a94a0975a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378141:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067e9ee13/0xcd9d312a94a0975a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378151:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067e9ee13/0xcd9d312a94a0975a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378158:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067e9ee13/0xcd9d312a94a0975a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378169:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.378173:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a09761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378179:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97460209b600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.378189:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a09761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378196:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a09761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378206:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a09761 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378212:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003810ce97/0xcd9d312a94a09761 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378225:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.378227:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.378229:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1784938852.378294:0:31427:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:40 00000100:00100000:3.0:1784938852.378379:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974603683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:35053:x1871643342585856:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 Request processed in 80482us (80576us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938852.378388:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 189 00002000:00010000:1.0:1784938852.378391:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.378397:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048ee5227/0xcd9d312a94a09768 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378405:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.378408:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.378413:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048ee5227/0xcd9d312a94a09768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378424:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048ee5227/0xcd9d312a94a09768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378431:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048ee5227/0xcd9d312a94a09768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378459:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048ee5227/0xcd9d312a94a09768 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378473:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938852.378481:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.378484:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048ee5227/0xcd9d312a94a09768 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378491:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.378494:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048ee5227/0xcd9d312a94a09768 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378502:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048ee5227/0xcd9d312a94a09768 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378513:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048ee5227/0xcd9d312a94a09768 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378522:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048ee5227/0xcd9d312a94a09768 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378535:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.378537:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.378539:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.378602:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.378608:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938852.378894:0:35053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35053:1871643342585856:192.168.202.104@tcp:5:osp-pre-1-0.0 00000004:00080000:3.0:1784938852.378911:0:35053:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x61:0x0] from OST, last_created [0x280000400:0x61:0x0]last_used is [0x280000400:0x28:0x0] 00000100:00100000:3.0:1784938852.378955:0:35053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35053:1871643342586112:192.168.202.104@tcp:5:osp-pre-1-0.0 00002000:00010000:1.0:1784938852.378964:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.378976:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a0976f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378984:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.378987:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.378991:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a0976f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.378999:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a0976f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.379008:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a0976f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.379014:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a0976f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.379025:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938852.379026:0:35053:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026db480 going to sleep for 11 seconds 00010000:00010000:1.0:1784938852.379033:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.379037:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a0976f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.379043:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e01800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.379047:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a0976f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.379055:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a0976f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.379072:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a0976f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.379080:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8e8aee2/0xcd9d312a94a0976f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.379093:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.379095:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.379097:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938852.379123:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938852.379200:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342586112 00000100:00100000:1.0:1784938852.379207:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342586112 00000100:00100000:1.0:1784938852.379260:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 191 00000100:00100000:1.0:1784938852.379270:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974602fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:35053:x1871643342586112:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1784938852.379311:0:33065:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 98 00002000:00080000:1.0:1784938852.380169:0:33065:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 106 00000001:00080000:1.0:1784938852.380643:0:33065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967351 00002000:00080000:1.0:1784938852.380731:0:33065:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 114 00002000:00010000:2.0:1784938852.381272:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938852.381281:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005349e6ee/0xcd9d312a94a09776 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.381308:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:2.0:1784938852.381313:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938852.381319:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005349e6ee/0xcd9d312a94a09776 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938852.381324:0:33065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967352 00010000:00010000:2.0:1784938852.381333:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005349e6ee/0xcd9d312a94a09776 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.381342:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005349e6ee/0xcd9d312a94a09776 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.381350:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005349e6ee/0xcd9d312a94a09776 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.381375:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1784938852.381519:0:33065:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 8 objects in group 0x280000400 at 122 00002000:00010000:2.0:1784938852.381775:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938852.381781:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e999b0ab/0xcd9d312a94a0977d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.381790:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:2.0:1784938852.381793:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938852.381798:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e999b0ab/0xcd9d312a94a0977d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.381820:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e999b0ab/0xcd9d312a94a0977d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.381828:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e999b0ab/0xcd9d312a94a0977d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.381836:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e999b0ab/0xcd9d312a94a0977d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.381849:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000001:00080000:1.0:1784938852.382080:0:33065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967353 00002000:00010000:2.0:1784938852.382136:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938852.382141:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a09784 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382149:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:2.0:1784938852.382152:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938852.382156:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a09784 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382164:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a09784 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382171:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a09784 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382187:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a09784 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382200:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1784938852.382234:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974602fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:35053:x1871643342586112:12345-192.168.202.104@tcp:5:osp-pre-1-0.0 Request processed in 2960us (3106us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1784938852.382244:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 191 00000020:00080000:1.0:1784938852.382251:0:33065:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00002000:00010000:2.0:1784938852.382494:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938852.382499:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0978b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382508:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:2.0:1784938852.382510:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938852.382514:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0978b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382522:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0978b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382529:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0978b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382535:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0978b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382542:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1784938852.382567:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784938852.382574:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005349e6ee/0xcd9d312a94a09776 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382588:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.382592:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005349e6ee/0xcd9d312a94a09776 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382600:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005349e6ee/0xcd9d312a94a09776 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382614:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005349e6ee/0xcd9d312a94a09776 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382621:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005349e6ee/0xcd9d312a94a09776 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382636:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938852.382639:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e999b0ab/0xcd9d312a94a0977d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382645:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892600 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.382648:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e999b0ab/0xcd9d312a94a0977d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382655:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e999b0ab/0xcd9d312a94a0977d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382664:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e999b0ab/0xcd9d312a94a0977d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382688:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e999b0ab/0xcd9d312a94a0977d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382701:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938852.382704:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a09784 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382711:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709892800 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.382714:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a09784 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382721:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a09784 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382731:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a09784 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382739:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067c14333/0xcd9d312a94a09784 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382769:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.382773:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0978b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382779:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893e00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.382788:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0978b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382797:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0978b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382808:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0978b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382816:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ce2437/0xcd9d312a94a0978b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382829:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.382831:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.382832:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938852.382908:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938852.382912:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09792 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382922:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:2.0:1784938852.382924:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938852.382927:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09792 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382934:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09792 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382938:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09792 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382943:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09792 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.382957:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938852.382979:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.382983:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09792 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.382990:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.382994:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09792 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.383002:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09792 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.383011:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09792 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.383025:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8fe98a1/0xcd9d312a94a09792 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.383037:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.383039:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.383040:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938852.383195:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938852.383199:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4207314/0xcd9d312a94a09799 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.383205:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:2.0:1784938852.383207:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938852.383209:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4207314/0xcd9d312a94a09799 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.383215:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4207314/0xcd9d312a94a09799 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.383228:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4207314/0xcd9d312a94a09799 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.383232:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4207314/0xcd9d312a94a09799 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.383243:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938852.383263:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938852.383268:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4207314/0xcd9d312a94a09799 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.383275:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974709893a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:1.0:1784938852.383278:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4207314/0xcd9d312a94a09799 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.383286:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4207314/0xcd9d312a94a09799 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.383296:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4207314/0xcd9d312a94a09799 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.383303:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4207314/0xcd9d312a94a09799 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.383316:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.383317:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.383319:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.383844:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938852.383902:0:35053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35053:1871643342586112:192.168.202.104@tcp:5:osp-pre-1-0.0 00000004:00080000:3.0:1784938852.383919:0:35053:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x61:0x0]-[0x280000400:0x81:0x0] 00010000:00010000:3.0:1784938852.383936:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938852.384647:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.384656:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aed092f4/0xcd9d312a94a097a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.384669:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.384683:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.384688:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aed092f4/0xcd9d312a94a097a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.384700:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aed092f4/0xcd9d312a94a097a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.384708:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aed092f4/0xcd9d312a94a097a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.384714:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aed092f4/0xcd9d312a94a097a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.384882:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938852.385210:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.385216:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000573acb1c/0xcd9d312a94a097a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.385226:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.385228:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.385232:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000573acb1c/0xcd9d312a94a097a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.385255:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000573acb1c/0xcd9d312a94a097a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.385264:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000573acb1c/0xcd9d312a94a097a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.385271:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000573acb1c/0xcd9d312a94a097a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.385370:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938852.385378:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aed092f4/0xcd9d312a94a097a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.385386:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00a00 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:2.0:1784938852.385391:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aed092f4/0xcd9d312a94a097a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.385401:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aed092f4/0xcd9d312a94a097a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.385420:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aed092f4/0xcd9d312a94a097a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938852.385428:0:31441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aed092f4/0xcd9d312a94a097a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.385565:0:31441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938852.385571:0:31441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000573acb1c/0xcd9d312a94a097a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.385591:0:31441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00200 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.385594:0:31441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000573acb1c/0xcd9d312a94a097a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.385603:0:31441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000573acb1c/0xcd9d312a94a097a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.385614:0:31441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000573acb1c/0xcd9d312a94a097a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.385623:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.385624:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.385627:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.385700:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784938852.385705:0:31428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000573acb1c/0xcd9d312a94a097a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938852.386064:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.386071:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a097ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.386080:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.386083:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.386088:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a097ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.386098:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a097ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.386119:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a097ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.386126:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a097ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.386278:0:30618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938852.386284:0:30618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a097ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.386291:0:30618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00000 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.386294:0:30618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a097ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.386380:0:30618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a097ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.386393:0:30618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a097ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.386409:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.386411:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.386413:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.386469:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784938852.386483:0:31428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092e032ea/0xcd9d312a94a097ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938852.386881:0:31428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938852.386888:0:31428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a097b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.386897:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=1006s v=(0 0) 00010000:00010000:1.0:1784938852.386900:0:31428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938852.386905:0:31428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a097b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.386914:0:31428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a097b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.386923:0:31428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a097b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938852.386941:0:31428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a097b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.387532:0:30619:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938852.387540:0:30619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a097b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.387549:0:30619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974741e00400 already unused, calling callback (ffffffffc14344a0) 00010000:00010000:3.0:1784938852.387554:0:30619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a097b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.387563:0:30619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a097b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.387579:0:30619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a097b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.387587:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.387589:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938852.387591:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938852.387697:0:31428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784938852.387703:0:31428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020f8b0d4/0xcd9d312a94a097b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938852.387897:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1784938852.393453:0:31428:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:41 00000100:00100000:1.0:1784938852.394043:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:35051:x1871643342585984:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 Request processed in 77637us (77737us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938852.394054:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 190 00000100:00100000:2.0:1784938852.394367:0:35051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:35051:1871643342585984:192.168.202.104@tcp:5:osp-pre-0-0.0 00000004:00080000:2.0:1784938852.394383:0:35051:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x61:0x0] from OST, last_created [0x240000400:0x61:0x0]last_used is [0x240000400:0x29:0x0] 00000100:00100000:2.0:1784938852.394438:0:35051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:35051:1871643342586240:192.168.202.104@tcp:5:osp-pre-0-0.0 00000100:00100000:2.0:1784938852.394627:0:35051:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe61840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938852.394802:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938852.394832:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342586240 00000100:00100000:1.0:1784938852.394838:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342586240 00000100:00100000:1.0:1784938852.394888:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 192 00000100:00100000:1.0:1784938852.394897:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746047bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:35051:x1871643342586240:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 00002000:00080000:1.0:1784938852.394942:0:31427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 98 00002000:00080000:1.0:1784938852.396258:0:31427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 106 00000001:00080000:1.0:1784938852.397244:0:31427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967351 00002000:00080000:1.0:1784938852.397355:0:31427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 114 00000001:00080000:1.0:1784938852.397876:0:31427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967352 00002000:00080000:1.0:1784938852.397961:0:31427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 8 objects in group 0x240000400 at 122 00000001:00080000:1.0:1784938852.398605:0:31427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967353 00000100:00100000:1.0:1784938852.399010:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746047bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:35051:x1871643342586240:12345-192.168.202.104@tcp:5:osp-pre-0-0.0 Request processed in 4106us (4202us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1784938852.399022:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 192 00000020:00080000:1.0:1784938852.399036:0:31427:0:(tgt_main.c:784:tgt_ses_key_exit()) total 4 transactions per RPC 00000100:00100000:2.0:1784938852.399290:0:35051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:35051:1871643342586240:192.168.202.104@tcp:5:osp-pre-0-0.0 00000004:00080000:2.0:1784938852.399307:0:35051:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x61:0x0]-[0x240000400:0x81:0x0] 00010000:00010000:0.0:1784938852.732684:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784938853.042864:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784938853.042875:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff974740e48800 from 11 10000000:01000000:3.0:1784938853.042881:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784938853.042934:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460209a200/0xcd9d312a94a097bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938853.042963:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460209a200/0xcd9d312a94a097bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938853.042975:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460209a200/0xcd9d312a94a097bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938853.043001:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342586368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938853.043078:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938853.043133:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026db480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938853.043236:0:35022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342586368 00000100:00100000:1.0:1784938853.043243:0:35022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342586368 00000100:00100000:1.0:1784938853.043304:0:35022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784938853.043313:0:35022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9747062fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+10:30627:x1871643342586368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938853.043326:0:35022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938853.043340:0:35022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974741e00400/0xcd9d312a94a097c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a097bc expref: -99 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.043363:0:35022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974741e00400/0xcd9d312a94a097c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a097bc expref: 11 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.043374:0:35022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974741e00400/0xcd9d312a94a097c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a097bc expref: 11 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.043383:0:35022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e00400, rc 0) 00000100:00100000:1.0:1784938853.043431:0:35022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9747062fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30627:x1871643342586368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938853.043437:0:35022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784938853.044027:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342586368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938853.044044:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460209a200/0xcd9d312a94a097bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097c3 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.044053:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460209a200/0xcd9d312a94a097bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a097c3 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938853.044109:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342586496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.044145:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938853.044175:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747056e9900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938853.044189:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342586496 00000100:00100000:1.0:1784938853.044194:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342586496 00000100:00100000:1.0:1784938853.044221:0:35021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784938853.044228:0:35021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30627:x1871643342586496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784938853.044242:0:35021:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784938853.044259:0:35021:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784938853.044262:0:35021:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1784938853.044338:0:35021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30627:x1871643342586496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938853.044345:0:35021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784938853.044376:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342586496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784938853.044417:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784938853.044425:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460209a200/0xcd9d312a94a097bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097c3 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.044432:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460209a200/0xcd9d312a94a097bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097c3 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938853.044441:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784938853.044443:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff974724c7c800 from 39 10000000:01000000:1.0:1784938853.044446:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938853.044465:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e00000/0xcd9d312a94a097ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.044472:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974741e00000/0xcd9d312a94a097ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.044480:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974741e00000/0xcd9d312a94a097ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938853.044500:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342586624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.044522:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938853.044536:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9747056e9900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938853.044547:0:35022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342586624 00000100:00100000:1.0:1784938853.044550:0:35022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342586624 00000100:00100000:1.0:1784938853.044568:0:35022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784938853.044574:0:35022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+11:30627:x1871643342586624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938853.044580:0:35022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938853.044588:0:35022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974741e00200/0xcd9d312a94a097d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a097ca expref: -99 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.044602:0:35022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974741e00200/0xcd9d312a94a097d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a097ca expref: 12 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.044610:0:35022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974741e00200/0xcd9d312a94a097d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a097ca expref: 12 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.044616:0:35022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e00200, rc 0) 00000100:00100000:1.0:1784938853.044643:0:35022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342586624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938853.044649:0:35022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784938853.044691:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342586624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938853.044702:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974741e00000/0xcd9d312a94a097ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097d1 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.044709:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974741e00000/0xcd9d312a94a097ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a097d1 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938853.044779:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342586752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.044804:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938853.044819:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938853.044831:0:35045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342586752 00000100:00100000:1.0:1784938853.044834:0:35045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342586752 00000100:00100000:1.0:1784938853.044855:0:35045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784938853.044861:0:35045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342586752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.045085:0:35045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342586752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938853.045092:0:35045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784938853.045120:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342586752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.045145:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342586880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.045187:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938853.045200:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938853.045211:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342586880 00000100:00100000:1.0:1784938853.045214:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342586880 00000100:00100000:1.0:1784938853.045234:0:35021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784938853.045240:0:35021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342586880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.045372:0:35021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342586880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938853.045379:0:35021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784938853.045417:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342586880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784938853.046089:0:35101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 39 00000020:01000000:1.0:1784938853.046154:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-38 (rc=0) 10000000:01000000:1.0:1784938853.046167:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784938853.046175:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e00000/0xcd9d312a94a097ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097d1 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.046184:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974741e00000/0xcd9d312a94a097ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097d1 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938853.046191:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784938853.046194:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1784938853.046197:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784938853.046217:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e01800/0xcd9d312a94a097d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.046225:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974741e01800/0xcd9d312a94a097d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.046234:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974741e01800/0xcd9d312a94a097d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938853.046250:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.046281:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938853.046297:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974724c1de40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938853.046311:0:35022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342587008 00000100:00100000:1.0:1784938853.046315:0:35022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342587008 00000100:00100000:1.0:1784938853.046344:0:35022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784938853.046350:0:35022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+12:30627:x1871643342587008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938853.046359:0:35022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938853.046370:0:35022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974741e00e00/0xcd9d312a94a097df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a097d8 expref: -99 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.046402:0:35022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974741e00e00/0xcd9d312a94a097df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a097d8 expref: 13 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.046412:0:35022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974741e00e00/0xcd9d312a94a097df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a097d8 expref: 13 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.046421:0:35022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e00e00, rc 0) 00000100:00100000:1.0:1784938853.046453:0:35022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342587008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938853.046460:0:35022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784938853.046495:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938853.046507:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974741e01800/0xcd9d312a94a097d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097df expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.046516:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974741e01800/0xcd9d312a94a097d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a097df expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938853.046553:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.046576:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938853.046589:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746036959c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938853.046600:0:35045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342587136 00000100:00100000:1.0:1784938853.046603:0:35045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342587136 00000100:00100000:1.0:1784938853.046623:0:35045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784938853.046628:0:35045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342587136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.056134:0:35045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342587136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 9497us (9549us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938853.056162:0:35045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784938853.067484:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.067566:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.067658:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938853.067899:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342587264 00000100:00100000:2.0:1784938853.067906:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342587264 00000100:00100000:2.0:1784938853.067961:0:35021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784938853.067970:0:35021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342587264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.068375:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460ab34c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938853.088890:0:35021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342587264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 20740us (21051us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938853.088906:0:35021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784938853.089246:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784938853.093691:0:35105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 8 00000020:01000000:1.0:1784938853.093936:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-7 (rc=0) 10000000:01000000:1.0:1784938853.093954:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784938853.093966:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e01800/0xcd9d312a94a097d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097df expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.093978:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974741e01800/0xcd9d312a94a097d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097df expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938853.093988:0:30627:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784938853.093991:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff974724c7c800 from 7 10000000:01000000:1.0:1784938853.093993:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938853.094033:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a097e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.094042:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a097e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.094053:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a097e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938853.094081:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.094153:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938853.094192:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974603695d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938853.094539:0:35022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342587392 00000100:00100000:0.0:1784938853.094547:0:35022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342587392 00000100:00100000:0.0:1784938853.094589:0:35022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938853.094595:0:35022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+13:30627:x1871643342587392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938853.094606:0:35022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938853.094619:0:35022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609396e00/0xcd9d312a94a097ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a097e6 expref: -99 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.094642:0:35022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609396e00/0xcd9d312a94a097ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a097e6 expref: 14 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.094652:0:35022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609396e00/0xcd9d312a94a097ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a097e6 expref: 14 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.094660:0:35022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609396e00, rc 0) 00000100:00100000:0.0:1784938853.094727:0:35022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342587392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938853.094747:0:35022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938853.094819:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938853.094831:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a097e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097ed expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.094838:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a097e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a097ed expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938853.094876:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.094894:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938853.094910:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460ab34f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938853.094919:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342587520 00000100:00100000:0.0:1784938853.094922:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342587520 00000100:00100000:0.0:1784938853.094936:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784938853.094939:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342587520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.095131:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342587520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938853.095136:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784938853.095161:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.095202:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.095232:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938853.095242:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460ab34f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938853.095250:0:35022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342587648 00000100:00100000:0.0:1784938853.095252:0:35022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342587648 00000100:00100000:0.0:1784938853.095265:0:35022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784938853.095274:0:35022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342587648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.095383:0:35022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342587648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938853.095390:0:35022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784938853.095423:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784938853.104226:0:35106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784938853.104319:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784938853.104338:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938853.104350:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a097e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097ed expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.104363:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974741e00800/0xcd9d312a94a097e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097ed expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938853.104372:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784938853.104375:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff974603c37000 from 39 10000000:01000000:0.0:1784938853.104378:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784938853.104418:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609397400/0xcd9d312a94a097f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.104426:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974609397400/0xcd9d312a94a097f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.104437:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974609397400/0xcd9d312a94a097f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938853.104468:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.104557:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938853.104611:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460ab340c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938853.104634:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342587776 00000100:00100000:0.0:1784938853.104641:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342587776 00000100:00100000:0.0:1784938853.104696:0:35021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784938853.104716:0:35021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+14:30627:x1871643342587776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938853.104730:0:35021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938853.104746:0:35021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609396000/0xcd9d312a94a097fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a097f4 expref: -99 pid: 35021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.104794:0:35021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609396000/0xcd9d312a94a097fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a097f4 expref: 15 pid: 35021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.104806:0:35021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609396000/0xcd9d312a94a097fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a097f4 expref: 15 pid: 35021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.104817:0:35021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609396000, rc 0) 00000100:00100000:0.0:1784938853.104858:0:35021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342587776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938853.104865:0:35021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784938853.104913:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938853.104927:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974609397400/0xcd9d312a94a097f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097fb expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.104936:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974609397400/0xcd9d312a94a097f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a097fb expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938853.105000:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.105027:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938853.105048:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460ab340c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938853.105062:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342587904 00000100:00100000:0.0:1784938853.105066:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342587904 00000100:00100000:0.0:1784938853.105093:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784938853.105101:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342587904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.105372:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342587904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938853.105379:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784938853.105412:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342587904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.105440:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.105483:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938853.105498:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460ab340c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938853.105510:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342588032 00000100:00100000:0.0:1784938853.105514:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342588032 00000100:00100000:0.0:1784938853.105536:0:35021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784938853.105542:0:35021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342588032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.115083:0:35021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342588032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 9531us (9590us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938853.115100:0:35021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784938853.115179:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784938853.132313:0:35108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 39 00000020:01000000:2.0:1784938853.132541:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-38 (rc=0) 10000000:01000000:2.0:1784938853.132563:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784938853.132575:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974609397400/0xcd9d312a94a097f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097fb expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938853.132587:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974609397400/0xcd9d312a94a097f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a097fb expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938853.132596:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784938853.132599:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1784938853.132602:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784938853.132640:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974709892a00/0xcd9d312a94a09802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938853.132649:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974709892a00/0xcd9d312a94a09802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938853.132683:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974709892a00/0xcd9d312a94a09802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938853.132719:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938853.132936:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938853.132979:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe61180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938853.133000:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342588160 00000100:00100000:2.0:1784938853.133008:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342588160 00000100:00100000:2.0:1784938853.133054:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784938853.133062:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460324d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+15:30627:x1871643342588160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938853.133075:0:35020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938853.133089:0:35020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974709892000/0xcd9d312a94a09809 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a09802 expref: -99 pid: 35020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938853.133113:0:35020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974709892000/0xcd9d312a94a09809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a09802 expref: 16 pid: 35020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938853.133124:0:35020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974709892000/0xcd9d312a94a09809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a09802 expref: 16 pid: 35020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938853.133133:0:35020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709892000, rc 0) 00000100:00100000:2.0:1784938853.133645:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460324d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342588160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 582us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938853.133653:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784938853.133828:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938853.133847:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974709892a00/0xcd9d312a94a09802 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09809 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938853.133865:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974709892a00/0xcd9d312a94a09802 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09809 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938853.133924:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938853.133954:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938853.133981:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe61180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938853.134573:0:35022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342588288 00000100:00100000:1.0:1784938853.134580:0:35022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342588288 00000100:00100000:1.0:1784938853.134639:0:35022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784938853.134647:0:35022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460115dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342588288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.135722:0:35022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460115dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342588288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1072us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938853.135732:0:35022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784938853.135948:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938853.135998:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938853.136048:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938853.141317:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97472fe61180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938853.141320:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342588416 00000100:00100000:0.0:1784938853.141331:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342588416 00000100:00100000:0.0:1784938853.141389:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784938853.141400:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460115c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342588416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.149193:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460115c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342588416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7782us (13130us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938853.149223:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784938853.149424:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784938853.151047:0:35113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 11 00000020:01000000:3.0:1784938853.151366:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-10 (rc=0) 10000000:01000000:3.0:1784938853.151388:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784938853.151400:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974709892a00/0xcd9d312a94a09802 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09809 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938853.151413:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974709892a00/0xcd9d312a94a09802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09809 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938853.151423:0:30627:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784938853.151426:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff97473bae19c0 from 1 10000000:01000000:3.0:1784938853.151429:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784938853.151466:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460209ae00/0xcd9d312a94a09810 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938853.151474:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460209ae00/0xcd9d312a94a09810 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938853.151485:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460209ae00/0xcd9d312a94a09810 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938853.151535:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938853.151597:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938853.151639:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026db780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938853.152682:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342588544 00000100:00100000:2.0:1784938853.154304:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342588544 00000100:00100000:2.0:1784938853.154395:0:35021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784938853.154406:0:35021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460115d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+16:30627:x1871643342588544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938853.154425:0:35021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938853.154445:0:35021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974709893000/0xcd9d312a94a09817 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a09810 expref: -99 pid: 35021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938853.154471:0:35021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974709893000/0xcd9d312a94a09817 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a09810 expref: 17 pid: 35021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938853.154482:0:35021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974709893000/0xcd9d312a94a09817 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a09810 expref: 17 pid: 35021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938853.154502:0:35021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974709893000, rc 0) 00000100:00100000:2.0:1784938853.154580:0:35021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460115d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342588544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (2982us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938853.154586:0:35021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784938853.154598:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938853.154616:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460209ae00/0xcd9d312a94a09810 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09817 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938853.154625:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460209ae00/0xcd9d312a94a09810 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09817 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938853.154654:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784938853.154660:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460209ae00/0xcd9d312a94a09810 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09817 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938853.154676:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460209ae00/0xcd9d312a94a09810 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09817 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938853.154684:0:30627:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938853.154686:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff974603c37000 from 7 10000000:01000000:3.0:1784938853.154689:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938853.154723:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460209b400/0xcd9d312a94a0981e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938853.154730:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97460209b400/0xcd9d312a94a0981e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938853.154738:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97460209b400/0xcd9d312a94a0981e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938853.154799:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938853.154833:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938853.154859:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9746026db780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938853.154917:0:35022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342588672 00000100:00100000:1.0:1784938853.154922:0:35022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342588672 00000100:00100000:1.0:1784938853.154958:0:35022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938853.154966:0:35022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460115f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+17:30627:x1871643342588672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938853.154974:0:35022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938853.154982:0:35022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974741e01c00/0xcd9d312a94a09825 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a0981e expref: -99 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.154996:0:35022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974741e01c00/0xcd9d312a94a09825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a0981e expref: 18 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.155004:0:35022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974741e01c00/0xcd9d312a94a09825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a0981e expref: 18 pid: 35022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.155011:0:35022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974741e01c00, rc 0) 00000100:00100000:1.0:1784938853.155046:0:35022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460115f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342588672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938853.155052:0:35022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938853.155083:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938853.155093:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97460209b400/0xcd9d312a94a0981e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09825 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.155100:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97460209b400/0xcd9d312a94a0981e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09825 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938853.155157:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.155181:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938853.155193:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974603695240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938853.155422:0:35045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342588800 00000100:00100000:3.0:1784938853.155427:0:35045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342588800 00000100:00100000:3.0:1784938853.155461:0:35045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784938853.155468:0:35045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342588800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938853.155736:0:35045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342588800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938853.155744:0:35045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784938853.156033:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.156064:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.156103:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938853.156132:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974603695240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938853.156228:0:35022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342588928 00000100:00100000:3.0:1784938853.156232:0:35022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342588928 00000100:00100000:3.0:1784938853.156265:0:35022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784938853.156272:0:35022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342588928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938853.156527:0:35022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342588928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938853.156534:0:35022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784938853.158571:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342588928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784938853.166037:0:35116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784938853.166108:0:30627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784938853.166124:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938853.166135:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97460209b400/0xcd9d312a94a0981e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09825 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.166147:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97460209b400/0xcd9d312a94a0981e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09825 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938853.166158:0:30627:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784938853.166161:0:30627:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97473bae19c0 from 1 10000000:01000000:1.0:1784938853.166163:0:30627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784938853.166202:0:30627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a0982c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.166211:0:30627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a0982c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938853.166242:0:30627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a0982c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938853.166267:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342589056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.167109:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938853.167159:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff974603695540 going to sleep for 11 seconds 00000100:00100000:0.0:1784938853.167302:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342589056 00000100:00100000:0.0:1784938853.167310:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342589056 00000100:00100000:0.0:1784938853.167361:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784938853.167371:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+18:30627:x1871643342589056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938853.167387:0:35020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938853.167403:0:35020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974609397600/0xcd9d312a94a09833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd9d312a94a0982c expref: -99 pid: 35020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.167427:0:35020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974609397600/0xcd9d312a94a09833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd9d312a94a0982c expref: 19 pid: 35020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.167438:0:35020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974609397600/0xcd9d312a94a09833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd9d312a94a0982c expref: 19 pid: 35020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.167447:0:35020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974609397600, rc 0) 00000100:00100000:0.0:1784938853.167492:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342589056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938853.167501:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784938853.167684:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342589056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938853.167700:0:30627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a0982c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09833 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.167719:0:30627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a0982c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd9d312a94a09833 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938853.167795:0:30627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342589184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938853.168380:0:30627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938853.168404:0:30627:0:(client.c:2702:ptlrpc_set_wait()) set ffff97460ab34d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938853.168659:0:35021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342589184 00000100:00100000:1.0:1784938853.168676:0:35021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342589184 00000100:00100000:1.0:1784938853.168724:0:35021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784938853.168732:0:35021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342589184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938853.168993:0:35021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:30627:x1871643342589184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (613us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784938853.169001:0:35021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784938853.170856:0:30627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754ce9ff-680f-4784-b8fd-fa933d4638f3:30627:1871643342589184:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1784938853.170906:0:30627:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784938853.170917:0:30627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a0982c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09833 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938853.170929:0:30627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974741e01a00/0xcd9d312a94a0982c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd9d312a94a09833 expref: -99 pid: 30627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938853.748224:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938854.774741:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784938854.892968:0:31424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967354 is committed 00000001:00100000:3.0:1784938854.893025:0:31424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1784938855.794926:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938856.827654:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784938856.920861:0:32270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967354 is committed 00000001:00100000:3.0:1784938856.920928:0:32270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:0.0:1784938857.228129:0:35313:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1784938857.335005:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342589312:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938857.335304:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938857.335335:0:31430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342589312 00000100:00100000:1.0:1784938857.335343:0:31430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342589312 00000100:00100000:1.0:1784938857.335401:0:31430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 37 00000100:00100000:1.0:1784938857.335412:0:31430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9746027bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342589312:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938857.335452:0:31430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40435712 pending 0 free 384827392 avail 382730240 00000100:00100000:1.0:1784938857.335492:0:31430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9746027bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342589312:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 81us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938857.335500:0:31430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 37 00000100:00080000:1.0:1784938857.335522:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938857.335664:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938857.335669:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784938857.335671:0:36:0:(import.c:65:import_set_state_nolock()) ffff974718b1c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938857.335680:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff974718b1c800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:2.0:1784938857.335711:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97460a354a80 x1871643342589568/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938857.335726:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938857.335730:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784938857.335732:0:36:0:(import.c:65:import_set_state_nolock()) ffff974729ece000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938857.335736:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff974729ece000 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:2.0:1784938857.335747:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97460a355180 x1871643342589696/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938857.335796:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784938857.335799:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784938857.335801:0:36:0:(import.c:65:import_set_state_nolock()) ffff97471da1c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938857.335806:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97471da1c800 using connection 192.168.202.104@tcp/192.168.202.104@tcp 00000100:00100000:2.0:1784938857.335836:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97460a357100 x1871643342589952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938857.335979:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342589440:0@lo:400:kworker.0 00000100:00100000:2.0:1784938857.336017:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938857.336070:0:12802:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967354 gen 2 00000100:00100000:2.0:1784938857.336094:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342589312:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938857.336115:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342589824:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938857.336155:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938857.336163:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342590080:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938857.336244:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938857.336297:0:12796:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938857.336317:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342589440 00000100:00100000:2.0:1784938857.336322:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342589440 00000100:00100000:2.0:1784938857.336352:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784938857.336359:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342589440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938857.336396:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342589440:12345-0@lo:400:kworker.0 Request processed in 38us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938857.336403:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784938857.336435:0:31430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342590080 00000100:00100000:2.0:1784938857.336439:0:31430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342590080 00000100:00100000:2.0:1784938857.336467:0:31430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 38 00000100:00100000:2.0:1784938857.336474:0:31430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342590080:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938857.336497:0:31430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40435712 pending 0 free 386924544 avail 384827392 00000100:00100000:2.0:1784938857.336528:0:31430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342590080:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 54us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938857.336542:0:31430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 38 00000100:00100000:2.0:1784938857.336570:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342589440:0@lo:400:kworker.0 00000100:00080000:2.0:1784938857.336586:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938857.336678:0:12804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967354 gen 2 00000100:00100000:2.0:1784938857.336693:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342590080:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938857.336980:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342589568:192.168.202.104@tcp:38:kworker.0 00000100:00100000:1.0:1784938857.337022:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342589696:192.168.202.104@tcp:38:kworker.0 00000100:00100000:1.0:1784938857.337044:0:12801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342589952:192.168.202.104@tcp:38:kworker.0 00000100:00100000:1.0:1784938857.337080:0:33065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342589824 00000100:00100000:1.0:1784938857.337084:0:33065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342589824 00000100:00100000:1.0:1784938857.337117:0:33065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 28 00000100:00100000:1.0:1784938857.337124:0:33065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342589824:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938857.337157:0:33065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342589824:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 33us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938857.337164:0:33065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 28 00000100:00100000:2.0:1784938857.339558:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938857.339580:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938857.339598:0:12797:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938857.339621:0:35029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342589568 00000100:00100000:2.0:1784938857.339629:0:35029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342589568 00000100:00100000:2.0:1784938857.339676:0:35029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342589696 00000100:00100000:2.0:1784938857.339679:0:35029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342589696 00000100:00100000:2.0:1784938857.339687:0:35029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342589952 00000100:00100000:2.0:1784938857.339689:0:35029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342589952 00000100:00100000:2.0:1784938857.339866:0:35029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:2.0:1784938857.339875:0:35029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:12801:x1871643342589568:12345-192.168.202.104@tcp:38:kworker.0 00010000:00080000:2.0:1784938857.339903:0:35029:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 1011 last 0 00000020:00000080:2.0:1784938857.339938:0:35029:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcd9d312a94a0983a 00000004:00100000:2.0:1784938857.339951:0:35029:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938857.340076:0:35029:0:(import.c:65:import_set_state_nolock()) ffff974609e43000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938857.340171:0:35029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:12801:x1871643342589568:12345-192.168.202.104@tcp:38:kworker.0 Request processed in 294us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938857.340178:0:35029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:2.0:1784938857.340207:0:35029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 6 00000100:00100000:2.0:1784938857.340211:0:35029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:12801:x1871643342589696:12345-192.168.202.104@tcp:38:kworker.0 00010000:00080000:2.0:1784938857.340232:0:35029:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 1011 last 0 00000020:00000080:2.0:1784938857.340253:0:35029:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcd9d312a94a09841 00000004:00100000:2.0:1784938857.340259:0:35029:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938857.340276:0:35029:0:(import.c:65:import_set_state_nolock()) ffff974609e47000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938857.340300:0:35029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:12801:x1871643342589696:12345-192.168.202.104@tcp:38:kworker.0 Request processed in 87us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938857.340306:0:35029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 6 00000100:00100000:2.0:1784938857.340320:0:35029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 7 00000100:00100000:2.0:1784938857.340324:0:35029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:12801:x1871643342589952:12345-192.168.202.104@tcp:38:kworker.0 00010000:00080000:2.0:1784938857.340336:0:35029:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@192.168.202.104@tcp t0 exp 0000000000000000 cur 1011 last 0 00000020:00000080:2.0:1784938857.340359:0:35029:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcd9d312a94a09848 00000004:00100000:2.0:1784938857.340364:0:35029:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938857.340378:0:35029:0:(import.c:65:import_set_state_nolock()) ffff974609e42000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938857.340399:0:35029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:12801:x1871643342589952:12345-192.168.202.104@tcp:38:kworker.0 Request processed in 74us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938857.340407:0:35029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 7 00000100:00100000:2.0:1784938857.340457:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342589824:192.168.202.104@tcp:400:kworker.0 00010000:00080000:1.0:1784938857.342611:0:12801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97460a354a80 x1871643342589568/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938857.342643:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1784938857.347436:0:12801:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff97460a354a80 x1871643342589568/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938867 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938857.347453:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974718b1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1784938857.347460:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974718b1c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784938857.347464:0:12801:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 192.168.202.104@tcp (at 192.168.202.104@tcp) 00000100:00100000:1.0:1784938857.367024:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:12801:1871643342589568:192.168.202.104@tcp:38:kworker.0 00010000:00080000:1.0:1784938857.367072:0:12801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97460a355180 x1871643342589696/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938857.367092:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1784938857.368502:0:12801:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff97460a355180 x1871643342589696/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938867 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938857.368534:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974729ece000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1784938857.368540:0:12801:0:(import.c:65:import_set_state_nolock()) ffff974729ece000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784938857.368544:0:12801:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 192.168.202.104@tcp (at 192.168.202.104@tcp) 00000100:00100000:1.0:1784938857.368550:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:12801:1871643342589696:192.168.202.104@tcp:38:kworker.0 00010000:00080000:1.0:1784938857.368580:0:12801:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97460a357100 x1871643342589952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938857.368592:0:12801:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1784938857.368598:0:12801:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1784938857.368602:0:12801:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784938857.368604:0:12801:0:(import.c:65:import_set_state_nolock()) ffff97471da1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784938857.368608:0:12801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:12801:1871643342589952:192.168.202.104@tcp:38:kworker.0 00010000:00010000:2.0:1784938857.849710:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938858.867236:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1784938859.382840:0:12802:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938843/real 1784938843] req@ffff974603683800 x1871643342580992/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938859 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938859.423114:0:12802:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff974603683800 x1871643342580992/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938859 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:3.0:1784938859.423396:0:12802:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938843/real 1784938843] req@ffff974603683b80 x1871643342580864/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938859 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938859.423415:0:12802:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff974603683b80 x1871643342580864/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938859 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938859.423456:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342580992:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938859.423462:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:12802:1871643342580864:192.168.202.104@tcp:400:kworker.0 00010000:00010000:2.0:1784938859.891058:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938860.915014:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938861.942674:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938862.450983:0:12803:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938862.451009:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342590208:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938862.451510:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342590464:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938862.451571:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342590976:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938862.451609:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938862.451616:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:12804:1871643342590592:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938862.451659:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342590720:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938862.451685:0:12802:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784938862.451690:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342590336:0@lo:400:kworker.0 00000100:00100000:3.0:1784938862.451737:0:12802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938862.451798:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974608ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342590848:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938862.452327:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938862.452378:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938862.452396:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938862.452427:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938862.452446:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:0.0:1784938862.452482:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938862.452821:0:35045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342590336 00000100:00100000:1.0:1784938862.452829:0:35045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342590336 00000100:00100000:1.0:1784938862.452875:0:35045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784938862.452884:0:35045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12802:x1871643342590336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938862.452951:0:35045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12802:x1871643342590336:12345-0@lo:400:kworker.0 Request processed in 68us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938862.452959:0:35045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784938862.452995:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342590720 00000100:00100000:1.0:1784938862.452999:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342590720 00000100:00100000:1.0:1784938862.453030:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342590848 00000100:00100000:1.0:1784938862.453032:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342590848 00000100:00100000:1.0:1784938862.453051:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 29 00000100:00100000:1.0:1784938862.453058:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342590720:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938862.453109:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342590720:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 51us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938862.453116:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 29 00000100:00100000:1.0:1784938862.453129:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 30 00000100:00100000:1.0:1784938862.453136:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342590848:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938862.453164:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342590848:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 29us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938862.453170:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 30 00000100:00100000:0.0:1784938862.453439:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938862.453453:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342591104:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938862.453964:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938862.454114:0:31430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342590208 00000100:00100000:2.0:1784938862.454121:0:31430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342590208 00000100:00100000:2.0:1784938862.454144:0:31430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342591104 00000100:00100000:2.0:1784938862.454147:0:31430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342591104 00000100:00100000:2.0:1784938862.454159:0:31430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 39 00000100:00100000:2.0:1784938862.454165:0:31430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342590208:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938862.454193:0:31430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40435712 pending 0 free 386924544 avail 384827392 00000100:00100000:2.0:1784938862.454227:0:31430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342590208:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 62us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938862.454233:0:31430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 39 00000100:00100000:2.0:1784938862.454246:0:31430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 40 00000100:00100000:2.0:1784938862.454251:0:31430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342591104:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938862.454268:0:31430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40435712 pending 0 free 384827392 avail 382730240 00000100:00100000:2.0:1784938862.454285:0:31430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342591104:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938862.454290:0:31430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 40 00000100:00100000:2.0:1784938862.454305:0:35028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342590464 00000100:00100000:2.0:1784938862.454308:0:35028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342590464 00000100:00100000:2.0:1784938862.454326:0:35028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342590976 00000100:00100000:2.0:1784938862.454328:0:35028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342590976 00000100:00100000:2.0:1784938862.454337:0:35028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342590592 00000100:00100000:2.0:1784938862.454339:0:35028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342590592 00000100:00100000:2.0:1784938862.454351:0:35028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:2.0:1784938862.454356:0:35028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342590464:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938862.454388:0:35028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12804:x1871643342590464:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 32us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938862.454394:0:35028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 0 00000100:00100000:2.0:1784938862.454462:0:35028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:2.0:1784938862.454471:0:35028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342590976:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938862.454495:0:35028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12804:x1871643342590976:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 26us (2099us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938862.454500:0:35028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 1 00000100:00100000:2.0:1784938862.454513:0:35028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00100000:2.0:1784938862.454698:0:35028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974608ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:12804:x1871643342590592:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938862.454724:0:35028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974608ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:12804:x1871643342590592:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 206us (2297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938862.454731:0:35028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 2 00000100:00080000:2.0:1784938862.454779:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938862.454783:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938862.454785:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938862.455036:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754ce9ff-680f-4784-b8fd-fa933d4638f3:12802:1871643342590336:0@lo:400:kworker.0 00000100:00100000:3.0:1784938862.455054:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342590848:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938862.455066:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342590720:192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938862.455188:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342591104:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938862.455345:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342590208:192.168.202.104@tcp:13:osp-pre-0-0.0 00010000:00080000:1.0:1784938862.460111:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974608ff9500 x1871643342590464/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938862.460133:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342590464:192.168.202.104@tcp:400:kworker.0 00010000:00080000:1.0:1784938862.460149:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974608ff8a80 x1871643342590976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938862.460159:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:12804:1871643342590976:192.168.202.104@tcp:400:kworker.0 00010000:00080000:1.0:1784938862.460190:0:12804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974608ff9180 x1871643342590592/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938862.460199:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974608ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:12804:1871643342590592:192.168.202.104@tcp:400:kworker.0 00010000:00010000:2.0:1784938862.963082:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938863.986964:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1784938864.501027:0:12802:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938848/real 1784938848] req@ffff974603681c00 x1871643342581376/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938864 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938864.501067:0:12802:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff974603681c00 x1871643342581376/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938864 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938864.501088:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:12802:1871643342581376:192.168.202.104@tcp:400:kworker.0 00000100:00000400:1.0:1784938864.504789:0:12804:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938848/real 1784938848] req@ffff974603680000 x1871643342581248/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938864 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938864.504823:0:12804:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff974603680000 x1871643342581248/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938864 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938864.504857:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974603680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:12804:1871643342581248:192.168.202.104@tcp:400:kworker.0 00010000:00010000:2.0:1784938865.014076:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938866.036994:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938867.059046:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938867.571131:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9746027bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342591232:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938867.571664:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:12805:1871643342591616:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938867.571732:0:12802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342591744:192.168.202.104@tcp:400:kworker.0 00000100:00100000:2.0:1784938867.571840:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342591360:0@lo:400:kworker.0 00000100:00100000:2.0:1784938867.571895:0:12803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938867.571927:0:12803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342591872:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938867.586265:0:12805:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784938867.586287:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342591488:192.168.202.104@tcp:400:kworker.0 00000100:00100000:0.0:1784938867.586585:0:12804:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938867.586595:0:12804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97460a35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342592128:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938867.587680:0:35020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342591360 00000100:00100000:0.0:1784938867.587690:0:35020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342591360 00000100:00100000:0.0:1784938867.587739:0:35020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784938867.587747:0:35020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff974601f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342591360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938867.587849:0:35020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff974601f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754ce9ff-680f-4784-b8fd-fa933d4638f3+19:12803:x1871643342591360:12345-0@lo:400:kworker.0 Request processed in 102us (15952us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938867.587856:0:35020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784938867.591994:0:12805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff974602fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342592000:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938867.592631:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754ce9ff-680f-4784-b8fd-fa933d4638f3:12803:1871643342591360:0@lo:400:kworker.0 00000100:00100000:2.0:1784938867.604920:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938867.604977:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:1.0:1784938867.605085:0:31427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342591744 00000100:00100000:1.0:1784938867.605097:0:31427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342591744 00000100:00100000:1.0:1784938867.605169:0:31427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 31 00000100:00100000:1.0:1784938867.605179:0:31427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342591744:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:1.0:1784938867.605254:0:31427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342591744:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 76us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938867.605261:0:31427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 31 00000100:00100000:3.0:1784938867.605435:0:31430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342591232 00000100:00100000:3.0:1784938867.605440:0:31430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342591232 00000100:00100000:3.0:1784938867.605485:0:31430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 41 00000100:00100000:3.0:1784938867.605493:0:31430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342591232:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938867.605523:0:31430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40435712 pending 0 free 384827392 avail 382730240 00000100:00100000:3.0:1784938867.605570:0:31430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12802:x1871643342591232:12345-192.168.202.104@tcp:13:osp-pre-1-0.0 Request processed in 79us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938867.605578:0:31430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 41 00000100:00080000:2.0:1784938867.605797:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938867.605802:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938867.617048:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:3.0:1784938867.617246:0:35028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342591488 00000100:00100000:3.0:1784938867.617258:0:35028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342591488 00000100:00100000:3.0:1784938867.617334:0:35028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00100000:3.0:1784938867.617348:0:35028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342591488:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938867.617422:0:35028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:12805:x1871643342591488:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 79us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938867.617430:0:35028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 3 00000100:00080000:2.0:1784938867.619818:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938867.620285:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9746027bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342591232:192.168.202.104@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938867.620397:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938867.620431:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938867.620453:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938867.620470:0:12795:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.104@tcp (source: 12345-192.168.202.104@tcp) 00000100:00100000:2.0:1784938867.620514:0:31428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342591872 00000100:00100000:2.0:1784938867.620520:0:31428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342591872 00000100:00100000:2.0:1784938867.620582:0:31428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 32 00000100:00100000:2.0:1784938867.620597:0:31428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342591872:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938867.620626:0:35028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342591616 00000100:00100000:3.0:1784938867.620630:0:35028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342591616 00000100:00100000:3.0:1784938867.620664:0:35028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342592000 00000100:00100000:3.0:1784938867.620667:0:35028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342592000 00000100:00100000:2.0:1784938867.620668:0:31428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:12803:x1871643342591872:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 73us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938867.620676:0:31428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 32 00000100:00100000:3.0:1784938867.620680:0:35028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00100000:3.0:1784938867.620685:0:35028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:12805:x1871643342591616:12345-192.168.202.104@tcp:400:kworker.0 00000100:00080000:2.0:1784938867.620711:0:30626:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938867.620715:0:35028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:12805:x1871643342591616:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 29us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938867.620721:0:35025:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784938867.620727:0:35025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1784938867.620767:0:35028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 4 00000100:00100000:3.0:1784938867.620785:0:35028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:3.0:1784938867.620791:0:35028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342592000:12345-192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938867.620816:0:35028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:12805:x1871643342592000:12345-192.168.202.104@tcp:400:kworker.0 Request processed in 26us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938867.620820:0:35028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 5 00000100:00100000:3.0:1784938867.620931:0:31430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643342592128 00000100:00100000:3.0:1784938867.620935:0:31430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643342592128 00000100:00100000:3.0:1784938867.620969:0:31430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.104@tcp, seq: 42 00000100:00100000:3.0:1784938867.620976:0:31430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97460134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342592128:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938867.621006:0:31430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40435712 pending 0 free 386924544 avail 384827392 00000100:00100000:3.0:1784938867.621048:0:31430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97460134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:12804:x1871643342592128:12345-192.168.202.104@tcp:13:osp-pre-0-0.0 Request processed in 71us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938867.621054:0:31430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.104@tcp, seq: 42 00000100:00100000:2.0:1784938867.621599:0:12802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:12802:1871643342591744:192.168.202.104@tcp:400:kworker.0 00010000:00080000:2.0:1784938867.621640:0:12805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974602fb6a00 x1871643342591488/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938867.621651:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:12805:1871643342591488:192.168.202.104@tcp:400:kworker.0 00010000:00080000:2.0:1784938867.621668:0:12805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974602fb7b80 x1871643342592000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938867.621684:0:12804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97460a35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:12804:1871643342592128:192.168.202.104@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938867.621705:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:12805:1871643342592000:192.168.202.104@tcp:400:kworker.0 00000100:00100000:3.0:1784938867.621716:0:12803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:12803:1871643342591872:192.168.202.104@tcp:400:kworker.0 00010000:00080000:2.0:1784938867.621719:0:12805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974602fb5180 x1871643342591616/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.202.104@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938867.621726:0:12805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff974602fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:12805:1871643342591616:192.168.202.104@tcp:400:kworker.0 00010000:00010000:2.0:1784938868.082900:0:30618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938869.115734:0:30619:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784938869.153614:0:35666:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-scrub test_5: @@@@@@ FAIL: (11) Expected 'crashed' on mds1 00010000:00010000:0.0:1784938870.132800:0:31441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41721 lines, 41721 kept, 0 dropped, 0 bad.